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Preface 


T he study of signals and systems is considered to be a classic subject in the 
curriculum of most engineering schools throughout the world. The theory of 
signals and systems is a coherent and elegant collection of mathematical re- 
sults that date back to the work of Fourier and Laplace and many other famous 
mathematicians and engineers. Signals and systems theory has proven to be an 
extremely valuable tool for the past 70 years in many fields of science and engi- 
neering, including power systems, automatic control, communications, circuit de- 
sign, filtering, and signal processing. Fantastic advances in these fields have 
brought revolutionary changes into our lives. 

At the heart of signals and systems theory is mankind’s historical curiosity and 
need to analyze the behavior of physical systems with simple mathematical mod- 
els describing the cause-and-effect relationship between quantities. For example, 
Isaac Newton discovered the second law of rigid-body dynamics over 300 years 
ago and described it mathematically as a relationship between the resulting force 
applied on a body (the input) and its acceleration (the output), from which one 
can also obtain the body’s velocity and position with respect to time. The develop- 
ment of differential calculus by Leibniz and Newton provided a powerful tool for 
modeling physical systems in the form of differential equations implicitly relating 
the input variable to the output variable. 

A fundamental issue in science and engineering is to predict what the behav- 
ior, or output response, of a system will be for a given input signal. Whereas sci- 
ence may seek to describe natural phenomena modeled as input-output systems, 
engineering seeks to design systems by modifying and analyzing such models. 
This issue is recurrent in the design of electrical or mechanical systems, where a 
system’s output signal must typically respond in an appropriate way to selected 
input signals. In this case, a mathematical input-output model of the system would 
be analyzed to predict the behavior of the output of the system. For example, in the 
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design of a simple resistor-capacitor electrical circuit to be used as a filter, the en- 
gineer would first specify the desired attenuation of a sinusoidal input voltage of a 
given frequency at the output of the filter. Then, the design would proceed by se- 
lecting the appropriate resistance R and capacitance C in the differential equation 
model of the filter in order to achieve the attenuation specification. The filter can 
then be built using actual electrical components. 

A signal is defined as a function of time representing the evolution of a vari- 
able. Certain types of input and output signals have special properties with respect 
to linear time-invariant systems. Such signals include sinusoidal and exponential 
functions of time. These signals can be linearly combined to form virtually any 
other signal, which is the basis of the Fourier series representation of periodic sig- 
nals and the Fourier transform representation of aperiodic signals. 

The Fourier representation opens up a whole new interpretation of signals in 
terms of their frequency contents called the frequency spectrum. Furthermore, in the 
frequency domain, a linear time-invariant system acts as a filter on the frequency 
spectrum of the input signal, attenuating it at some frequencies while amplifying it 
at other frequencies. This effect is called the frequency response of the system. 
These frequency domain concepts are fundamental in electrical engineering, as they 
undeipin the fields of communication systems, analog and digital filter design, feed- 
back control, power engineering, etc. Well-trained electrical and computer engi- 
neers think of signals as being in the frequency domain probably just as much as 
they think of them as functions of time. 

The Fourier transform can be further generalized to the Laplace transform in 
continuous-time and the z- transform in discrete-time. The idea here is to define 
such transforms even for signals that tend to infinity with time. We chose to adopt 
the notation instead of X(a>) or X(f), for the Fourier transform of a contin- 

uous-time signal x(t). This is consistent with the Laplace transform of the signal 
denoted as X(s), since then X( j(0) = A(.y)| s - J0) . The same remark goes for the dis- 
crete-time Fourier transform: X(e J0> ) = X(z)\ z=e jw. 

Nowadays, predicting a system’s behavior is usually done through computer 
simulation. A simulation typically involves the recursive computation of the out- 
put signal of a discretized version of a continuous-time system model. A large part 
of this book is devoted to the issue of system discretization and discrete-time sig- 
nals and systems. The MATLAB software package is used to compute and display 
the results of some of the examples. The companion CD-ROM contains the MAT- 
LAB script files, problem solutions, and interactive graphical applets that can help 
the student visualize difficult concepts such as the convolution and Fourier series. 
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Undergraduate students see the theory of signals and systems as a difficult sub- 
ject. The reason may be that signals and systems is typically one of the first courses 
an engineering student encounters that has substantial mathematical content. So 
what is the required mathematical background that a student should have in order 
to learn from this book? Well, a good background in calculus and trigonometry def- 
initely helps. Also, the student should know about complex numbers and complex 
functions. Finally, some linear algebra is used in the development of state-space 
representations of systems. The student is encouraged to review these topics care- 
fully before reading this book. 

My wish is that the reader will enjoy learning the theory of signals and systems 
by using this book. One of my goals is to present the theory in a direct and straight- 
forward manner. Another goal is to instill interest in different areas of specializa- 
tion of electrical and computer engineering. Learning about signals and systems 
and its applications is often the point at which an electrical or computer engineer- 
ing student decides what she or he will specialize in. 


Benoit Boulet 
March 2005 
Montreal, Canada 
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((Lecture 


1: Signal Models)) 


I n this first chapter, we introduce the concept of a signal as a real or complex 
function of time. We pay special attention to sinusoidal signals and to real and 
complex exponential signals, as they have the fundamental property of keeping 
their “identity” under the action of a linear time-invariant (LTI) system. We also in- 
troduce the concept of a system as a relationship between an input signal and an 
output signal. 
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Fundamentals of Signals and Systems 


SYSTEMS IN ENGINEERING 


The word system refers to many different things in engineering. It can be used to 
designate such tangible objects as software systems, electronic systems, computer 
systems, or mechanical systems. It can also mean, in a more abstract way, theoret- 
ical objects such as a system of linear equations or a mathematical input-output 
model. In this book, we greatly reduce the scope of the definition of the word 
system to the latter; that is, a system is defined here as a mathematical relationship 
between an input signal and an output signal. Note that this definition of system is 
different from what we are used to. Namely, the system is usually understood to 
be the engineering device in the field, and a mathematical representation of this 
system is usually called a system model. 


FUNCTIONS OF TIME AS SIGNALS 


Signals are functions of time that represent the evolution of variables such as a fur- 
nace temperature, the speed of a car, a motor shaft position, or a voltage. There are 
two types of signals: continuous-time signals and discrete-time signals. 
Continuous-time signals are functions of a continuous variable (time). 

Example 1.1: The speed of a car v(t) as shown in Figure 1.1. 



FIGURE 1.1 Continuous-time signal 
representing the speed of a car. 


Discrete-time signals are functions of a discrete variable; that is, they are de- 
fined only for integer values of the independent variable (time steps). 


Example 1.2: The value of a stock x\ri\ at the end of month n, as shown in Figure 

1 . 2 . 
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FIGURE 1.2 Discrete-time signal 
representing the value of a stock. 


Note how the discrete values of the signal are represented by points linked to 
the time axis by vertical lines. This is done for the sake of clarity, as just showing 
a set of discrete points “floating” on the graph can be confusing to interpret. 

Continuous-time and discrete-time functions map their domain T (time inter- 
val) into their co-domain V (set of values). This is expressed in mathematical 
notation as / : T — » V . The range of the function is the subset TC{ /' J cV of the 
co-domain, in which each element v e 7 Z{f} has a corresponding time t in the 
domain T such that v = f(t). This is illustrated in Figure 1.3. 



FIGURE 1.3 Domain, co-domain, and range 
of a real function of continuous time. 


If the range 1Z{f} is a subset of the real numbers R, then /is said to be a real 
signal. If TZ{f} is a subset of the complex numbers C, then /is said to be a com- 
plex signal. We will study both real and complex signals in this book. Note that we 
often use the notation x(t) to designate a continuous-time signal (not just the value 
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of x at time t ) and x\n\ to designate a discrete-time signal (again for the whole sig- 
nal, not just the value of x at time n). 

For the car speed example above, the domain of v(t) could be T = [0,+°°) with 
units of seconds, assuming the car keeps on running forever, and the range is 
V = [0,+°o) a R ? the set of all non-negative speeds in units of kilometers per hour. 

For the stock trend example, the domain of x[n] is the set of positive natural num- 
bers T - {1,2,3,. . .} , the co-domain is the non-negative reals V = [0,+°°) cr R 5 and 
the range could be TZ{x) = [0,100] in dollar unit. 

An example of a complex signal is the complex exponential x(t) = e jl0t , for 
which T = R , V = C , and 7Z{xj = {z e C : |z| = 1}; that is, the set of all complex 
numbers of magnitude equal to one. 


TRANSFORMATIONS OF THE TIME VARIABLE 


Consider the continuous-time signal x(t) defined by its graph shown in Figure 1.4 
and the discrete-time signal x[n ] defined by its graph in Figure 1.5. As an aside, 
these two signals are said to be of finite support, as they are nonzero only over a 
finite time interval, namely on ^ [-2,2] for x(t) and when n e {-3, ...,3} for x[n\. 
We will use these two signals to illustrate some useful transformations of the time 
variable, such as time scaling and time reversal. 



FIGURE 1.4 Graph of continuous 
time signal x(t). 



FIGURE 1.5 Graph of discrete-time 
signal x\n\. 


Time Scaling 

Time scaling refers to the multiplication of the time variable by a real positive con- 
stant a. In the continuous-time case, we can write 


y(t ) = x(at). 


( 1 . 1 ) 
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Case 0 < a < 1 : The signal x(t) is slowed down or expanded in time. Think of 
a tape recording played back at a slower speed than the nominal speed. 

Example 1.3: Case a — \ shown in Figure 1.6. 



FIGURE 1.6 Graph of expanded signal 
y(f)=*(0.5f). 


Case a > 1 : The signal x(t) is sped up or compressed in time. Think of a tape 
recording played back at twice the nominal speed. 

Example 1.4: Case a = 2 shown in Figure 1.7. 



FIGURE 1.7 Graph of compressed signal y(t ) =x(2t). 


For a discrete-time signal x[n], we also have the time scaling 

y\n] = x[an], (1.2) 

but only the case a > 1 , where a is an integer, makes sense, as x[n] is undefined for 
fractional values of n. In this case, called decimation or downsampling, we not only 
get a time compression of the signal, but the signal can also lose part of its infor- 
mation; that is, some of its values may disappear in the resulting signal y[n\. 
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Example 1.5: Case a = 2 shown in Figure 1.8. 



FIGURE 1.8 Graph of compressed signal 
y[n]=x[2n]. 


In Chapter 12, upsampling, which involves inserting m - 1 zeros between con- 
secutive samples, will be introduced as a form of time expansion of a discrete-time 
signal. 

Time Reversal 

A time reversal is achieved by multiplying the time variable by -1. The resulting 
continuous-time and discrete-time signals are shown in Figure 1.9 and Figure 1.10, 
respectively. 



FIGURE 1.9 Graph of time-reversed 
signal y(t) =x(-t). 


FIGURE 1.10 Graph of time-reversed 
signal y[n] =x[-n]. 
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Time Shift 

A time shift delays or advances the signal in time by a continuous-time interval 
T el: 

y(t) = x(t + T). (1.3) 

For T positive, the signal is advanced; that is, it starts at time t — -4, which is 
before the time it originally started at, t — -2, as shown in Figure 1.11. For T neg- 
ative, the signal is delayed, as shown in Figure 1.12. 



FIGURE 1.11 Graph of time-advanced 

signal y(t) =x(t + 2). FIGURE 1.12 Graph of time-delayed 

5 signal y{t) =x(t - 2). 


Similarly, a time shift delays or advances a discrete-time signal by an integer 
discrete-time interval A: 

y[ri\ = x[n + N~\. (1.4) 

For Apositive, the signal is advanced by N time steps, as shown in Figure 1.13. 
For A negative, the signal is delayed by |a| time steps. 



FIGURE 1.13 Graph of time-advanced 
signal y[n] =x[n + 2], 
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PERIODIC SIGNALS 


Intuitively, a signal is periodic when it repeats itself. This intuition is captured in 
the following definition: a continuous-time signal x(t) is periodic if there exists a 
positive real T for which 


x(t) = x(t + T), VteM. 


(1.5) 


A discrete-time signal x[n\ is periodic if there exists a positive integer N for 
which 


x\ri\ = x\n + N\, V« 6 Z. (1.6) 

The smallest such Tor A is called the fundamental period of the signal. 

Example 1.6: The square wave signal in Figure 1 . 14 is periodic. The fundamental 

period of this square wave is T= 4, but 8, 12, and 16 are also periods of the signal. 



Example 1.7: The complex exponential signal x(t) = e J(0 ° : 

x(t + T) = e j0) ° (t+T) = w (1.7) 

The right-hand side of Equation 1.7 is equal to x(t) = e Jb)(>) for T = 
k = ±1,± 2,. . ., so these are all periods of the complex exponential. The fundamen- 
tal period is T = —. 

It may become 0 more apparent that the complex exponential signal is periodic 
when it is expressed in its real/imaginary form: 

x(t) = = cos(ay)+ /sin(m (| t). 


( 1 . 8 ) 
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where it is clear that the real part, cos(« 0 t), and the imaginary part, sin(m ( i), are 
periodic with fundamental period T = '\ 

Example 1.8: The discrete-time signal x\n\ = {- 1)" in Figure 1.15 is periodic 

with fundamental period N= 2. 



EXPONENTIAL SIGNALS 


Exponential signals are extremely important in signals and systems analysis be- 
cause they are invariant under the action of linear time-invariant systems, which 
will be discussed in Chapter 2. This means that the output of an LTI system sub- 
jected to an exponential input signal will also be an exponential with the same ex- 
ponent, but in general with a different real or complex amplitude. 

Example 1.9: Consider the LTI system represented by a first-order differential 

equation initially at rest, with input x(t) = e 2 ‘ : 

^jp- + y(t) = x(t). (1.9) 

at 

Its output signal is given by y(t) = -e~ 2< . (Check it!) 

Real Exponential Signals 

Real exponential signals can be defined both in continuous time and in discrete time. 

Continuous Time 

We can define a general real exponential signal as follows: 


x{t) = Ce a ‘, O^C.aef. 


( 1 . 10 ) 
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We now look at different cases depending on the value of parameter a. 

Case a = 0: We simply get the constant signal x(t) = C . 

Case a > 0: The exponential tends to infinity as t — > +°° , as shown in Figure 
1.16, where C> 0. Notice that x(0) = C. 

Case a < 0: The exponential tends to zero as t — > ; see Figure 1.17, where 

C<0. 



FIGURE 1.16 Continuous-time 
exponential signal growing unbounded 
with time. 



FIGURE 1.17 Continuous-time 
exponential signal tapering off to 
zero with time. 


Discrete Time 

We define a general real discrete-time exponential signal as follows: 

x[n\ = Ca”, C,ael. (1.11) 

There are six cases to consider, apart from the trivial cases a = 0 or C = 0: 
a = 1, a > 1, 0 < a < 1, a < -1, a = -1, and -1 < a < 0 . Flere we assume that 
C > 0, but for C negative, the graphs would simply be flipped images of the ones 
given around the time axis. 

Case a = 1 : We get a constant signal x[n\ = C. 

Case a. > 1 : We get a positive signal that grows exponentially, as shown in 
Figure 1.18. 



FIGURE 1.18 Discrete-time exponential 
signal growing unbounded with time. 
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Case 0 < a < 1 : The signal x[n\ = Ca" is positive and decays exponentially, as 
shown in Figure 1.19. 

Case a < — 1: The signal x\ri\ = Ca" alternates between positive and negative 
values and grows exponentially in magnitude with time. This is shown in Figure 1 .20. 



FIGURE 1.19 Discrete-time 
exponential signal tapering off to 
zero with time. 



FIGURE 1.20 Discrete-time 
exponential signal alternating and 
growing unbounded with time. 


Case a — — 1: The signal alternates between C and -C, as seen in Figure 1.21. 
Case -1 < a < 0 : The signal alternates between positive and negative values 
and decays exponentially in magnitude with time, as shown in Figure 1.22. 


x[n\ 

■f 


1 < 

» < 

* C ( 

> f 

-3 

-1 

1 

3 


-4 -2 2 4 




FIGURE 1.21 Discrete-time exponential 
signal reduced to an alternating periodic 
signal. 


FIGURE 1.22 Discrete-time exponential 
signal alternating and tapering off to zero 
with time. 
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((Lecture 2: Some Useful Signals)) 


Complex Exponential Signals 

Complex exponential signals can also be defined both in continuous time and in 
discrete time. They have real and imaginary parts with sinusoidal behavior. 


Continuous Time 

The continuous-time complex exponential signal can be defined as follows: 

x(t):=Ce at , C,aeC, (1.12) 

where C = Ae' 9 , A,6eM.,A> 0 is expressed in polar form, and a-a + 
jco Q , cc,co 0 gI is expressed in rectangular form. Thus, we can write 

x(t) = Ae je e (a+J%> ‘ 

= Ae m e J<0, " ,+e) (1.13) 


If we look at the second part of Equation 1.13, we can see thatx(t) represents 
either a circular or a spiral trajectory in the complex plane, depending whether a is 
zero, negative, or positive. The term e j( ' w "' +e) describes a unit circle centered at the 
origin counterclockwise in the complex plane as time varies from t = -°o to 
t = +°° , as shown in Figure 1.23 for the case 0 = 0. The times t k indicated in the 
figure are the times when the complex point e i<0 °‘ k has a phase of n / 4 . 


\m{e M } 



FIGURE 1.23 Trajectory described by the complex exponential. 
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Using Euler’s relation, we obtain the signal in rectangular form: 

x(t) = Ae al cos(co 0 t + 0) + jAe°" sin(® 0 t + 9), (1.14) 

where Re{x(t)} = Ae al cos{co 0 t + 6) and lm{x(t)} = Ae at sin(co 0 t + 9) are the real 
part and imaginary part of the signal, respectively. Both are sinusoidal, with time- 
varying amplitude (or envelope) Ae °“ . We can see that the exponent a = Re{a} 
defines the type of real and imaginary parts we get for the signal. 

For the case a — 0, we obtain a complex periodic signal of period T = — 
(as shown in Figure 1.23 but with radius A ) whose real and imaginary parts are 
sinusoidal: 


x(t) = Acos(co 0 t + 9) + jAsm(co 0 t + 9). (1.15) 

The real part of this signal is shown in Figure 1.24. 



FIGURE 1.24 Real part of periodic complex 
exponential for a = 0. 


For the case a < 0, we get a complex periodic signal multiplied by a decaying ex- 
ponential. The real and imaginary parts are damped sinusoids that are signals that can 
describe, for example, the response of an RLC (resistance-inductance-capacitance) 
circuit or the response of a mass-spring-damper system such as a car suspension. The 
real part of x(t) is shown in Figure 1.25. 

For the case a > 0, we get a complex periodic signal multiplied by a growing 
exponential. The real and imaginary parts are growing sinusoids that are signals 
that can describe the response of an unstable feedback control system. The real part 
of x(t) is shown in Figure 1.26. 
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FIGURE 1.25 Real part of damped complex exponential 
for a < 0. 



FIGURE 1.26 Real part of growing complex exponential 
for a > 0. 



ON THE CD 


The MATLAB script given below and located on the CD-ROM in D:\Chap- 
terl\complexexp.m, where D: is assumed to be the CD-ROM drive, generates and 
plots the real and imaginary parts of a decaying complex exponential signal. 


%% complexexp.m generates a complex exponential signal and plots 
%% its real and imaginary parts. 

% time vector 
t=0 : .005:1 ; 

% signal parameters 
A-i ; 
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theta=pi/4; 

C=A*exp ( j *theta) ; 
alpha=-3; 
w0=20 ; 

a=alpha+j *w0; 

% Generate signal 
x=C*exp(a*t) ; 

%plot real and imaginary parts 

figure ( 1 ) 

plot(t, real(x) ) 

figure(2) 

plot (t , imag (x) ) 


Discrete Time 

The discrete-time complex exponential signal can be defined as follows: 


x[n\ = Ca", (1.16) 

whereC,aeC, C = Ae je , A,6 eR,A> 0 a = re' Wl> ,r,(O 0 eR,r> 0. 

Substituting the polar forms of C and a in Equation 1 . 1 6, we obtain a useful ex- 
pression for x[n] with time-varying amplitude: 


jc[«] = Ae je r n e Jm ° n 
= Ar n e i(%n+0 \ 


(1.17) 


and using Euler’s relation, we get the rectangular form of the discrete-time com- 
plex exponential: 


x[n\ = Ar" cos (co 0 n + 6) + jAr" sin (co Q n + 6). (1.18) 

Clearly, the magnitude r of a determines whether the envelope of x[n] grows, 
decreases, or remains constant with time. 

For the case r — 1 , we obtain a complex signal whose real and imaginary parts 
have a sinusoidal envelope (they are sampled cosine and sine waves), but the sig- 
nal is not necessarily periodic ! We will discuss this issue in the next section. 

x[n] = Acos(co 0 n + 6) + jAsin(co 0 n + 6) (1.19) 

Figure 1.27 shows the real part of a complex exponential signal with r — 1. 
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For the case r < 1 , we get a complex signal whose real and imaginary parts are 
damped sinusoidal signals (see Figure 1.28). 




FIGURE 1.27 Real part of discrete- 
time complex exponential forr= 1. FIGURE 1.28 Real part of discrete-time 

damped complex exponential for r< 1 . 


For the case r > 1 , we obtain a complex signal whose real and imaginary parts 
are growing sinusoidal sequences, as shown in Figure 1.29. 

Re{x[n]} = Ar" cos {co a n + 0) 




i 


i 


1 


l 




FIGURE 1.29 Real part of growing complex exponential 
for r > 1 . 



ON THE CD 


The MATLAB script given below and located on the CD-ROM in D:\Chapterl\ 
complexDTexp.m generates and plots the real and imaginary parts of a decaying 
discrete-time complex exponential signal. 
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%% complexDTexp.m generates a discrete-time 
%% complex exponential signal and plots 
%% its real and imaginary parts. 

% time vector 
n=0 : 1 : 20 ; 

% signal parameters 
A-i ; 

theta=pi/4; 

C=A*exp ( j *theta) ; 
r=0 . 8 ; 
w0=0.2*pi; 
a=r*exp(j*wO) ; 

% Generate signal 
x=C*(a. A n) ; 

%plot real and imaginary parts 

figure ( 1 ) 

stem(n, real(x) ) 

figure(2) 

stem(n,imag(x) ) 


PERIODIC COMPLEX EXPONENTIAL AND SINUSOIDAL SIGNALS 


In our study of complex exponential signals so far, we have found that in the cases 
a = Re{a} = 0 in continuous time and r = |a| = 1 in discrete time, we obtain sig- 
nals whose trajectories lie on the unit circle in the complex plane. In particular, 
their real and imaginary parts are sinusoidal signals. We will see that in the con- 
tinuous-time case, these signals are always periodic, but that is not necessarily the 
case in discrete time. Periodic complex exponentials can be used to define sets of 
harmonically related exponentials that have special properties that will be used 
later on to define the Fourier series. 

Continuous Time 

In continuous time, complex exponential and sinusoidal signals of constant ampli- 
tude are all periodic. 

Periodic Complex Exponentials 

Consider the complex exponential signal e . We have already shown that this 

• • • • TT 

signal is periodic with fundamental period T = — . Now let us consider harmoni- 
cally related complex exponential signals : 

<t> k (t)-=e ]km < f , k = ... ,-2,-1, 0,1,2,..., 


( 1 . 20 ) 
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that is, complex exponentials with fundamental frequencies that are integer multi- 
ples of co 0 . These harmonically related signals have a very important property: they 
form an orthogonal set. Two signals x( t), y(t ) are said to be orthogonal over an in- 
terval \t v t 2 \ if their inner product, as defined in Equation 1.21, is equal to zero: 


jx(t)* y(t)dt = 0, 


( 1 . 21 ) 


where x* (t) is the complex conjugate of x(t). This notion of orthogonality is a gen- 
eralization of the concept of perpendicular vectors in three-dimensional Euclidean 


space R 3 . Two such perpendicular (or orthogonal) vectors 
inner product equal to zero: 


have an 


M r V = [Mj U 2 « 3 ] 


= U l V l +U 2 V 2 + ll 3 V , =I», =0 - 


( 1 . 22 ) 


We know that a set of three orthogonal vectors can span the whole space R 3 
by forming linear combinations and therefore would constitute a basis for this 
space. It turns out that harmonically related complex exponentials (or complex 
harmonics) can also be seen as orthogonal vectors forming a basis for a space of 
vectors that are actually signals over the interval [t ,t \. This space is infinite- 
dimensional, as there are infinitely many complex harmonics of increasing fre- 
quencies. It means that infinite linear combinations of the type X a k <j) k (t ) can 
basically represent any function of time in the signal space, which is the basis for 
the Fourier series representation of signals. 

We now show that any two distinct complex harmonics <p k (t) = e jkc ""‘ and 
<j> m (t) = e jm%l , where m ■£ k are indeed orthogonal over their common period 

rj-< 27r t 

fi) n * 


J $ k (ty$ m (t)dt= J e^e'^dt = J e j(m - k)%t dt 

0 0 

1 


0 


j(m - k)a> 0 


e j(m-k)2jt _ j 
=1 


= 0 . 


(1.23) 


However, the inner product of a complex harmonic with itself evaluates to 

In m 


(O r 
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In In 2 n 

(o 0 co 0 0 ) Q 

| <p k (t)* <p k (t)dt = J e ' ka>,> ‘ e jka "' dt = J dt 

ooo 


2 n 


co n 


(1.24) 


Sinusoidal Signals 

Continuous-time sinusoidal signals of the type x(t) = Acos(d) 0 t + 9) or x(t) = 
Asm{a> t + 6) such as the one shown in Figure 1.30 are periodic with (fundamental) 
period T = ^ , frequency f 0 = ^ in Hertz, angular frequency co 0 in radians per 
second, and amplitude \A\ . It is important to remember that in sinusoidal signals, or 
any other periodic signal, the shorter the period, the higher the frequency. For 
instance, in communication systems, a 1-MHz sine wave carrier has a period of 
1 microsecond (10~ 6 s), while a 1-GHz sine wave carrier has a period of 1 nano- 
second (10" 9 s). 



FIGURE 1.30 Continuous-time sinusoidal signal. 


The following useful identities allow us to see the link between a periodic 
complex exponential and the sine and cosine waves of the same frequency and 
amplitude. 


Acos( 0 ) 0 t + 0 ) = ^-e je e i% ' + ye je e Jc ° 0 ' = R e{Ae Ao>0 ' +B> }, (1.25) 

Asin(co Q t + 9) = e i6 e jm "' ~~ e~ j6 e ~ Jai = lm{Ae J(m ° t+9) }. 


(1.26) 
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Discrete Time 

In discrete time, complex exponential and sinusoidal signals of constant amplitude 
are not necessarily periodic. 

Complex Exponential Signals 

The complex exponential signal Ae' co ° n is not periodic in general, although it seems 
like it is for any co 0 . The intuitive explanation is that the signal values, which are 
points on the unit circle in the complex plane, do not necessarily fall at the same 
locations as time evolves and the circle is described counterclockwise. When the 
signal values do always fall on the same points, then the discrete-time complex 
exponential is periodic. A more detailed analysis of periodicity is left for the next 
subsection on discrete-time sinusoidal signals, but it also applies to complex expo- 
nential signals. 

The discrete-time complex harmonic signals defined by 


</>,[«] := e 


jk- 


k = 0,...,N-\ 


(1.27) 


are periodic of (not necessarily fundamental) period N. They are also orthogonal, 
with the integral replaced by a sum in the inner product: 


2n . In N-l ./In 




x— i - /ft — n m — n , , , 

5 >*[«]»] = 5 > N e N =^e " 


\_ e Rm - k) T N 

Km-k) 1 /- 

\ — e N 


I — e' 


, j( m ~ k 'h % 

i-e N 


= 0, m ^ k. 


(1.28) 


Here there are only N such distinct complex harmonics. For example, for N = 
8, we could easily check that (j) 0 [n] = <j) [n] = 1. These signals will be used in Chap- 
ter 12 to define the discrete-time Fourier series. 


Sinusoidal Signals 

Discrete-time sinusoidal signals of the type x[n\ = Acos(a> 0 n + 0) are not always 
periodic , although the continuous envelope of the signal Acos(co n t + 9) is periodic 

2n u 

of period T = — . A periodic discrete-time sinusoid such as the one in Figure 1.31 is 
such that the signal values, which are samples of the continuous envelope, always 
repeat the same pattern over any period of the envelope. 
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▲ x[n\ = A cos (a> 0 n + 0) 


FIGURE 1.31 A periodic discrete-time 
sinusoidal signal. 


Mathematically, we saw that x[»] is periodic if there exists an integer N> 0 
such that 


x[n\ = x[n + N\ = Acos(a> 0 n + 0) Q N + 9). (1-29) 

That is, we must have co 0 N = 2nm for some integer m, or equivalently: 


(O 0 m 
2n ~ N’ 


(1.30) 


that is, 0> " must be a rational number (the ratio of two integers.) Then, the fiinda- 

^ K 

mental period N> 0 can also be expressed as m— , assuming m and N have no 
common factor. The fundamental frequency defined by 


Q 


o 


2 n _ co 0 
N m 


(1.31) 


is expressed in radians. When the integers m and N have a common integer factor, 
that is, m = m () q and N = N 0 q , then /V 0 is the fundamental period of the sinusoid. 
These results hold for the complex exponential signal e /< '" ,l " +Hl as well. 


FINITE-ENERGY AND FINITE-POWER SIGNALS 


We defined signals as very general functions of time, although it is of interest to de- 
fine classes of signals with special properties that make them significant in engi- 
neering. Such classes include signals with finite energy and signals of finite power. 
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The instantaneous power dissipated in a resistor of resistance R is simply the 
product of the voltage across and the current through the resistor: 


P(t) = V(t)l(t)= \ 

K 

(1.32) 

and the total energy > dissipated during a time interval \t x ,t 2 
grating the power 

] is obtained by inte- 

E ^ = \, l P{t)dt = \, l R dL 

(1.33) 

The average power dissipated over that interval is the total energy divided by 
the time interval: 

[ M 2 ] t 2 -t x ] h R 

(1.34) 

Analogously, the total energy and average power over [tptj of an arbitrary 
integrable continuous-time signal x(t) are defined as though the signal were a volt- 
age across a one-ohm resistor: 

I 2 *- 

(1.35) 

A,r=, 1 J/WO ?*. 
l 2 h 1 

(1.36) 

The total energy and total average power of a signal defined over t e R are de- 
fined as 

E x := lim [ \x(t) | 2 dt = [ | x(t) \ 2 dt, 

00 r->oo J -t j-oo 

(1.37) 



(1.39) 



Elementary Continuous-Time and Discrete-Time Signals and Systems 23 


P := y\ 2 |x[«]| 2 . 

{n " n 4 n-n,+ Jl 


(1.40) 


Notice that n 2 — n x + 1 is the number of points in the signal over the interval 
[n v n 2 \. The total energy and total average power of signal x[n\ defined over tie Z 
are defined as 


E ~ ■= l 2 - X” J • I 2 


P := lim 


1 rX!L>[”]| 2 . 


n^°° 2N + \ n= ~ N 


(1.41) 


(1.42) 


The class of continuous-time or discrete-time finite-energy > signals is defined 
as the set of all signals for which E x < +°° . 


1 , 0 < «< 10 


0, otherwise 


for which 


Example 1.10: The discrete-time signal x[«] := • 

E = 1 1 is a finite-energy signal. 

The class of continuous-time or discrete -time finite-power signals is defined as 
the set of all signals for which P x < +°o . 


Example 1.11: The constant signal x(t) = 4 has infinite energy, but a total aver- 

age power of 16: 

1 rT 4 2 

P := lim — 4~dt = \im — 2T = 16. (1.43) 

" r->°o 2T J-t r->oo 2 T 


The total average power of a periodic signal can be calculated over one period 
only as P = Ij' |x(t)| 2 dt. 

Example 1.12: For x(t) = Ce'"’"' , the total average power is computed as 


P =^JjCe i0V 


I 2 dt = J — - 


i c i 


(1.44) 


Note that e J0>a ' has unit power. 


EVEN AND ODD SIGNALS 


A continuous-time signal is said to be even if x(t ) = x(-t), and a discrete-time sig- 
nal is even if x[n ] = x[— w] . An even signal is therefore symmetric with respect to 
the vertical axis. 
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A signal is said to be odd if x(t) = -x(-t) or x\n] = -x\-n \ . Odd signals are 
symmetric with respect to the origin. Another way to view odd signals is that their 
portion at positive times can be flipped with respect to the vertical axis, then with 
respect to the horizontal axis, and the result corresponds exactly to the portion of 
the signal at negative times. It implies that x(0) = 0 or x[0] = 0 . 

Figure 1.32 shows a continuous-time even signal, whereas Figure 1.33 shows 
a discrete-time odd signal. 


x{t ) 




FIGURE 1.33 Odd discrete-time signal. 


Any signal can be decomposed into its even part and its odd part as follows: 
x(t) = x e (t) + x o (t) (1.45) 

Even part: x e (t) := ~j[x(t) + x(-t)\ (1.46) 

Odd part: x o (t) := ^[x(t) - x(-t)\ 


(1.47) 
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The even part and odd parts of a discrete-time signal are defined in the exact 
same way. 


DISCRETE-TIME IMPULSE AND STEP SIGNALS 


One of the simplest discrete-time signals is the unit impulse 8[n\, also called the 
Dirac delta function, defined by 


8[n\ 


f 1, n = 0 
[o, n 0 


(1.48) 


Its graph is shown in Figure 1.34. 


‘ k d'[«] 

ill 


n 

FIGURE 1.34 Discrete-time unit impulse. 


The discrete-time unit step signal u[n] is defined as follows: 


u[n] 


Jl ,»>0 
[o, n < 0 


The unit step is plotted in Figure 1.35. 


(1.49) 



FIGURE 1.35 Discrete-time unit 
step signal. 
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The unit step is the running sum of the unit impulse: 

(1 ‘ 50) 


and conversely, the unit impulse is the first-difference of a unit step: 

8[n] = u[n\-u[n- 1], (1.51) 

Also, the unit step can be written as an infinite sum of time-delayed unit impulses: 

u[n] = ^ j S[n- k], (1-52) 

k = 0 

The sampling property of the unit impulse is an important property in the the- 
ory of sampling and in the calculation of convolutions, both of which are discussed 
in later chapters. The sampling property basically says that when a signal x[n] is 
multiplied by a unit impulse occurring at time n 0 , then the resulting signal is an im- 
pulse at that same time, but with an amplitude equal to the signal value at time n 0 : 

x[n]8[n-n 0 \ = x[n 0 ]8[n-n 0 ]. (1.53) 

Another way to look at the sampling property is to take the sum of Equation 
1.53 to obtain the signal sample at time n 0 : 

'£ l x[k]8[k-n 0 \ = x[n Q \. (1.54) 

lc=-oo 



((Lecture 3: Generalized Functions and Input-Output System Models)) 


GENERALIZED FUNCTIONS 

Continuous-Time Impulse and Step Signals 

The continuous-time unit step function u(t), plotted in Figure 1.36, is defined as 
follows: 


u(t) := 


\\,t> 0 
[0, t < 0 


(1.55) 
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Note that since u(t) is discontinuous at the origin, it cannot be formally differ- 
entiated. We will nonetheless define the derivative of the step signal later and give 
its interpretation. 

One of the uses of the step signal is to apply it at the input of a system in order 
to characterize its behavior. The resulting output signal is called the step response 
of the system. Another use is to truncate some parts of a signal by multiplication 
with time-shifted unit step signals. 

Example 1.13: The finite-support signal x(t) shown in Figure 1.37 can be writ- 

ten as x(t) = e[u(t) - u(t - 1)] or as x(t) = e‘u(t)u(-t + 1) . 


x(t) 



FIGURE 1.37 Truncated exponential signal. 

The running integral of u(t) is the unit ramp signal tu(t) starting at t = 0, as 
shown in Figure 1.38: 

t 

| u(z)dz = tu(t) 


(1.56) 
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Successive integrals of u(t) yield signals with increasing powers of t : 


t A- i A ^ 

J J ••• j u(r)drdr l ---dz k _ 1 =— t k u(t) (1-57) 


The unit impulse S( t ) , a generalized function that has infinite amplitude over 
an infinitesimal support at t = 0 , can be defined as follows. Consider a rectangu- 
lar pulse function of unit area shown in Figure 1.39, defined as: 


1 


H 


A’ 

0 , 


0<t< A 
otherwise 


(1.58) 


1 

A 

k 

S,(t) 


w 

A 


FIGURE 1.39 Continuous-time 
rectangular pulse signal. 
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The running integral of this pulse is an approximation to the unit step, as shown 
in Figure 1.40. 


t 

u A (t):= J S A (z)dz 


— tu(t)~ — (t- A)u(t- A) 
A A 


(1.59) 



FIGURE 1.40 Integral of rectangular pulse signal 
approximating the unit step. 


As A tends to 0, the pulse <5 A (0 gets taller and thinner but keeps its unit area, 
which is the key property here, while ) approaches a unit step function. At the 
limit, 


8(t) := limc> A (t) 

V 7 A— >0 AV ^ 

(1.60) 

u(t) = lim u A (t) 

(1.61) 


Note that 8ft) = j uft ) , and in this sense we can write 8(t) = j t u(t) at the 

limit, so that the impulse is the derivative of the step. Conversely, we have the 
important relationship stating that the unit step is the running integral of the unit 
impulse: 


t 

u(t ) = J 8(z)dz 


(1.62) 


Graphically, 8(t) is represented by an arrow “pointing to infinity” at t — 0 
with its length equal to the area of the impulse, as shown in Figure 1.41. 
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i 


l 


5{t) 


* 


t 


FIGURE 1.41 Unit impulse signal. 


We mentioned earlier that the key property of the pulse S A (t) is that its area is 
invariant as A — > 0 . This means that the impulse 8(t) packs significant “punch,” 
enough to make a system react to it, even though it is zero at all times except at 
t = 0 . The output of a system subjected to the unit impulse is called the impulse 
response. 

Note that with the definition in Equation 1 .60, the area of the impulse lies to the 

right of t — 0, so that integrating A8(t) from t — 0 yields J AS{t)dt = A . Had we 

0 

defined the impulse as the limit of the pulse <5 a(0 := ^ [u(t + A) - u(t)\ whose area 

lies to the left of t — 0, we would have obtained J A8(t)dt = 0. In order to “catch 

0 

the impulse” in the integral, the trick is then to integrate from the left of the v-axis, 
but infinitesimally close to it. This time is denoted as t = 0”. Similarly, the time 
t = 0 + is to the right oft = 0 but infinitesimally close to it, so that for our defini- 
tion of 8( t) in Equation 1.60, the above integral would have evaluated to zero: 

J A8(t)dt = 0. 

0 + 

The following example provides motivation for the use of the impulse signal. 

Example 1.14: Instantaneous discharge of a capacitor. 

Consider the simple RC circuit depicted in Figure 1 .42, with a constant voltage 
source V having fully charged a capacitor C through a resistor R t . At time t = 0, 
the switch is thrown from position S 2 to position S, so that the capacitor starts dis- 
charging through resistor R. What happens to the current i(t) as R tends to zero? 
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FIGURE 1.42 Simple RC circuit for analysis of 
capacitor discharge. 


The capacitor is charged to a voltage V and a charge Q - CV at t — 0 . When 
the switch is thrown from S 2 to Sj at t = 0, we have: 


i(t) = 


v(0 


R 


i(t) = -C 


dv(t ) 
dt 


(1.63) 

(1.64) 


Combining Equation 1.63 and Equation 1.64, we get 

RC^ + v(t) = 0. 
dt 

The solution to this differential equation is 

v(0 = Ve~ t/RC u{t), 

and the current is simply 


i(t) = je-‘ IRC u(t), 


(1.65) 


( 1 . 66 ) 


(1.67) 


If we let R tend to 0, i(t) tends to a tall, sharp pulse whose area remains con- 
stant at Q = CV , the initial charge in the capacitor (as Q= J i(t)dt). We getanim- 

0 

pulse. Of course if you tried this in reality, that is, shorting a charged capacitor, it 
would probably blow up, thereby demonstrating that the current flowing through 
the capacitor went “really high” in a very short time, burning the device. 
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FIGURE 1.43 Capacitor discharge 
current in RC circuit. 


Some Properties of the Impulse Signal 
Sampling Property 

The pulse function 8 A (t) can be made narrow enough so that x(t)8 A (t) ~ x(0 )8 A (t), 
and at the limit, for an impulse at time t Q , 

x(t)S(t-t 0 ) = x(t 0 )8(t-t 0 ) (1.68) 

so that 

f x(t)8(t-t 0 )dt = x(t 0 ) (1.69) 

This last equation is often cited as the correct definition of an impulse, since it 
implicitly defines the impulse through what it does to any continuous function 
under the integral sign, rather than using a limiting argument pointwise, as we did 
in Equation 1.60. 

Time Scaling 

Time scaling of an impulse produces a change in its area. This is shown by cal- 
culating the integral in the sampling property with the time-scaled impulse. 
For aef,a#0: 
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+oo +00 

[ x(t) 8(at)dt = — [ x (— ) 8(z)dz 
J a a 

-j +00 

— [ x(—)8(z)dT, 

rv J r/ 


J x(-) S(T)dT, 
i a 

1 +00 

= r jx(-)S(T)dT 


= ] — ;*(0) 
a 


a >0 
a <0 


(1.70) 


Hence, 


8{at)=—S{t). (1.71) 

a 

Note that the equality sign in Equation 1.71 means that both of these impulses 
have the same effect under the integral in the sampling property. 

Time Shift 

The convolution of signals x{t) and y(t) is defined as 


x(t)*y(t):= J x(T)y(t-z)dT = J y(z)x(t - T)dz (1-72) 


The convolution of signal x(t) with the time-delayed impulse 8{t — T) delays 
the signal by T\ 


8(t - T) * x(t) = J <5( T - T)x(t - t)c/t = x(t - T) 


(1.73) 


Unit Doublet and Higher Order "Derivatives" of the Unit Impulse 

. d8(t) 

What is 0 ' ' j •- dt 5 the unit doublet ? That is, what does it do for a living? To an- 
swer this question, we look at the following integral, integrated by parts: 
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[ 8\t)x(t)dt = fx(0)(5(?)l - f 8{t)— x(t)dt 

j l J dt 


dx( 0) _ dx( 0) 
dt dt 


(1.74) 


Thus, the unit doublet samples the derivative of the signal at time t — 0 (mod- 
ulo the minus sign.) For higher order derivatives of 8(t), we have 

j 8 ik \t)x(t)dt = (-1)* d . (1.75) 

Why is S'(t) called a “doublet?” A possible representation of this generalized 
function comes from differentiating the pulse 8 A (t ) , which produces two impulses, 
one negative and one positive. Then by letting A — > 0 , we get a “double impulse” 
at t = 0, as shown in Figure 1.44. Note that the resulting “impulses” are not regu- 
lar impulses since their area is infinite. 



SYSTEM MODELS AND BASIC PROPERTIES 


Recall that we defined signals as functions of time. In this book, a system is also 
simply defined as a mathematical relationship, that is, a function, between an input 
signal x(t) or x[n] and an output signal y(t) or y[«]. Without going into too much d 
etail, recall that functions map their domain (set of input signals) into their co- 
domain (set of output signals, of which the range is a subset) and have the special 
property that any input signal in the domain of the system has a single associated 
output signal in the range of the system. 
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Input-Output System Models 

The mathematical relationship of a system H between its input signal and its out- 
put signal can be formally written as y = Hx (the time argument is dropped here, 
as this representation is used both for continuous-time and discrete-time systems). 
Note that this is not a multiplication by H — rather, it means that system (or func- 
tion) H is applied to the input signal. For example, system H could represent a very 
complicated nonlinear differential equation linking y(t) to x(t). 

A system is often conveniently represented by a block diagram, as shown in 
Figure 1.45 and Figure 1.46. 


x(t) 


H 


y(t) 


> 


FIGURE 1.45 Block diagram representation of 
a continuous-time system H. 


x[«] 


G 


y[n] 




FIGURE 1.46 Block diagram representation of 
a discrete-time system C. 


System Block Diagrams 

Systems may be interconnections of other systems. For example, the discrete-time 
system y\n\ = Gx[«] shown as a block diagram in Figure 1.47 can be described by 
the following system equations: 

v[n] = GjX[«] 
w[n\ = G 2 v[«] 
z[n] = G 3 x[«] 
x[h] = w {n\-z[n] 
y[n\ = G 4 s[n ] 


(1.76) 
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G 


FIGURE 1.47 A discrete-time system composed of an interconnection of other 
systems. 


We now look at some basic system interconnections, of which more complex 
systems are composed. 

Cascade Interconnection 

The cascade interconnection shown in Figure 1.48 is a successive application of 
two (or more) systems on an input signal: 

y = G 2 (Qx) (1.77) 

y\ 



FIGURE 1.48 Cascade interconnection of systems. 


Parallel Interconnection 

The parallel interconnection shown in Figure 1.49 is an application of two (or 
more) systems to the same input signal, and the output is taken as the sum of the 
outputs of the individual systems. 
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y = G l x + G 2 x (1.78) 

Note that because there is no assumption of linearity or any other property for 
systems G l ,G 2 , we are not allowed to write, for example, y = (G ] + G 2 )x . System 
properties will be defined later. 



FIGURE 1.49 Parallel interconnection of systems. 


Feedback Interconnection 

The feedback interconnection of two systems as shown in Figure 1.50 is a feedback 
of the output of system G t to its input, through system G 2 . This interconnection is 
quite useful in feedback control system analysis and design. In this context, signal 
e is the error between a desired output signal and a direct measurement of the out- 
put. The equations are 


e = x - G 2 y 

y - G x e (1.79) 



FIGURE 1.50 Feedback interconnection of systems. 
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Example 1.15: Consider the car cruise control system in Figure 1.51, whose task 

is to keep the car’s velocity close to its setpoint. The system G is a model of the car’s 
dynamics from the throttle input to the speed output, whereas system C is the con- 
troller, whose input is the velocity error e and whose output is the engine throttle. 




desired speed 


K> 


controller 


G 


car 


v(t) car speed 

► 


FIGURE 1.51 Feedback interconnection of a car cruise control system. 



((Lecture 4: Basic System Properties)) 


Basic System Properties 

All of the following system properties apply equally to continuous-time and discrete- 
time systems. 

Linearity 

A system S is linear if it has the additivity property and the homogeneity property. 
Lcty, := Sx x andy 2 '■= Sx 2 . 


Additivity: y x + y 2 = S(x x + x 2 ) (1 .80) 

That is, the response of S to the combined signal x x + x 2 is the sum of the indi- 
vidual responses y x and y 2 . 

Homogeneity: ay 1 = S(ax { ), VaeC (1.81) 

Homogeneity means that the response of S to the scaled signal ax x is a times 
the response y x = Sx x . An important consequence is that the response of a linear 
system to the 0 signal is the 0 signal. Thus, the system y(t) = 2 x(t) + 3 is nonlinear 
because forx(t) = 0, we obtain y(t) = 3. 
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The linearity property (additivity and homogeneity combined) is summarized in 
the important Principle of Superposition : the response to a linear combination of 
input signals is the same linear combination of the corresponding output signals. 

Example 1.16: Consider the ideal operational-amplifier (op-amp) integrator 

circuit shown in Figure 1.52. 


c 



The output voltage of this circuit is given by a running integral of the input 
voltage: 


1 f 

V ou, (t) =Jc[ VjT)dT (L82) 

If V in ( t ) = av ] (t) + bv 2 (0 , then 

l ^ ^ l) t 

V o“‘ (t)= RC J Vin(T)dT = lc 5 Vl(T)dT+ RC \ V ^ T)dT (L83) 

and hence this circuit is linear. 

Time Invariance 

A system S is time-invariant if its response to a time-shifted input signal x[n - A] 
is equal to its original response y\n\ to x[n], but also time shifted by A: y[n - N], 
That is, if for y[n] := Sx[n], jy [/?] := Sx[n - N], the equality yfn\ = y[n - A] holds 
for any integer A, then the system is time-invariant. 

Example 1.17: y(t) = sin(x(t)) is time-invariant since y x f) - sm(x{t — T)) = 

y(t-T). 
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On the other hand, the system y\n\ = nx[n] is not time-invariant (it is time- 
varying) since y l [«] = nx[n - N]^( n- N)x[n - N] = y[n - N] . 

The time-invariance property of a system makes its analysis easier, as it is suf- 
ficient to study, for example, the impulse response or the step response starting at 
time t — 0. Then, we know that the response to a time-shifted impulse would have 
the exact same shape, except it would be shifted by the same interval of time as the 
impulse. 

Memory 

A system is memoryless if its output y at time t or n depends only on the input at 
that same time. 

Examples of memoryless systems: 

y\n\ = x[n ] 2 


y( 0 = 


*(0 

1 + x(t) 


Resistor: v(t) = Ri(t). 

Conversely, a system has memory if its output at time t or n depends on input 
values at some other times. 

Examples of systems with memory: 

y\n\ = x[n + 1] + x\n\ + x[n - 1] 

t 

y(t ) = J x(z)dz 


Causality 

A system is causal if its output at time t or n depends only on past or current val- 
ues of the input. 

An important consequence is that if y { := Sx r y 2 := Sx 2 and x l (z) = x 2 (r), 
Vts(-o° ,t], then y x (z) = y 2 (r), Vt g . This means that a causal system 
subjected to two input signals that coincide up to the current time t produces out- 
puts that also coincide up to time t. This is not the case for noncausal systems 
because their output up to time t depends on future values of the input signals, 
which may differ by assumption. 
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Examples of causal systems: 

A car does not anticipate its driver’s actions, or the road condition ahead. 

n 

y[n\= Yj x{k - N\ N> 1 

k=-oo 

^ + ay(t) = bx(t) + cx(t — T) T> 0 
dt 

Example of a noncausal system: 

n 

y[n]= Yj x \n~k] 

Bounded-Input Bounded-Output Stability 

A system S is bounded-input bounded-output (BIBO) stable if for any bounded 
input x, the corresponding output y is also bounded. Mathematically, the continuous- 
time system y(t) = Sx(t ) is BIBO stable if 

\/K ] > 0, 3K, > 0 such that 

|x(t)| < K v - °° < t < °° => | v(/)| < K 2 , -o° < t < “ (1-84) 

In this statement, =» means implies, V means for every, and 3 means there 
exists. 

In other words, if we had a system S that we claimed was BIBO stable, then for 
any positive real number K x that someone challenges us with, we would have to 
find another positive real number K 2 such that, for any input signal x(t) bounded in 
magnitude by K ] at all times, the corresponding output signal y(t) of S would also 
be bounded in magnitude by K 2 at all times. This is illustrated in Figure 1.53. 



FIGURE 1.53 BIBO stability of a system. 
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Example 1.18: A resistor with characteristics v(t) = Ri(t) is BIBO stable. For all 
currents i(t) bounded by Aj amperes in magnitude, the voltage is bounded by 
K 2 = RK ] volts. However, the integrator op-amp circuit previously discussed is not 
BIBO stable, as a constant input would result in an output that tends to infinity as 
t — » “ . 

BIBO stability is very important to establish for feedback control systems and 
for analog and digital filters. 

Invertibility 

Recall that a system was defined as a function mapping a set of input signals (do- 
main) into a set of output signals (co-domain). The range of the system is the sub- 
set of output signals in the co-domain that are actually possible to get. 

It turns out that one can always restrict the co-domain of the system to be 
equal to its range, thereby making the system onto (surjective). Assuming this is 
the case, a system S is invertible if the input signal can always be uniquely recov- 
ered from the output signal. Mathematically, for x y ^ x 2 , y x = Sx v y 2 = Sx 2 , we 
have y s* y , which restricts the system to be one-to-one (injective). This means 
that two distinct input signals cannot lead to the same output signal. More gener- 
ally, functions are invertible if and only if they are both one-to-one and onto. 

The inverse system, formally written as S 1 (this is not the arithmetic inverse), 
is such that the cascade interconnection in Figure 1.54 is equivalent to the identity 
system, which leaves the input unchanged. 



FIGURE 1.54 Cascade interconnection of a 
system and its inverse. 

Example 1.19: The inverse system for y = 2x is just y = \x. 

Exercise: Check that the inverse system of the discrete-time running sum 
y[n\ = X x[k] is the first-difference system y[ri\ = x[n\-x[n-\\. 


SUMMARY 


In this chapter, we introduced the following concepts. 

■ A signal was defined as a function of time, either continuous or discrete. 

■ A system was defined as a mathematical relationship between an input signal 
and an output signal. 
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■ Special types of signals were studied: real and complex exponential signals, si- 
nusoidal signals, impulse and step signals. 

■ The main properties of a system were introduced: linearity, memory, causality, 
time invariance, stability, and invertibility. 


TO PROBE FURTHER 


There are many introductory textbooks on signals and systems, each organizing 
and presenting the material in a particular way. See, for example, Oppenheim, 
Willsky, and Nawab 1997; Haykin & Van Veen, 2002; and Kamen & Heck, 1999. 
For applications of signal models to specific engineering fields, see, for example, 
Gold & Morgan, 1 999 for speech and signal processing; Haykin, 2000 for modu- 
lated signals in telecommunications; and Bruce, 2000 for biomedical signals. For 
further details on system properties, see Chen, 1999. 


EXERCISES 


Exercises with Solutions 


Exercise 1.1 

Write the following complex signals in polar form, that is, in the form 
x(t) = r(t)e jeit \ r{t),0(t) e R, r(t) > 0 for continuous-time signals and x[«] = 
r\n]e jew , r\n\,6[n\ e R, r\n\ > 0 for discrete-time signals. 


(a) 


x(t) = 


t 

1 + jt 


Answer: 


x(t) = 


t 

1 + jt 



e jm 


=> K0 = 



0(0 = - 


arctan 


arctan 


v 1; 
v ly 


+ 7T, 


?>0 
t< 0 
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(b) x[n\ = nje" +J , n> 0 
Answer: 

x\n\ = nje n+j = ne n e j(l+n ^ 2 \ n> 0 
=> r[n] = ne n , 0[«] = 1 + tt/2 


Exercise 1.2 

Determine whether the following systems are: (1) memoryless, (2) time-invariant, (3) 
linear, (4) causal, or (5) BIBO stable. Justify your answers. 

(a) y[n] = x[l-«] 

Answer: 

1 . Memory less? No. For example, the output y[0] = x[l] depends on a future 
value of the input. 

2. Time- invariant? No. 


y x [n] = Sx[n - ?V] = x[l - n — N] 

^ x[l -(n- N)] = x[l- n + ?V)] = y[n - iV] 


3. Linear? Yes. Let Vj[n] := Sx^ri] = xjl- n\, jy [n] := .Vx, [n] = x 2 [1 - n] . Then, 
the output of the system with x[«] := ccx l [n] + f3x 2 [n] is given by: 


y = Sx : 

y[n] = x[l - n\ = ax 1 [1 - n\ + f5x 2 [1 - n] 
= ay 1 [n] + f3y 2 [n] 


4. Causal? No. For example, the output y[0] = x[l] depends on a future value 
of the input. 

5. Stable? Yes. |*[n]| < B, V« => \y[n]\ = |x[l - n ] | < 5, Vn . 


(b) 


y(t) = 


x(t) 

1 + x(t — 1) 


Answer: 

1. Memoryless? No. The system has memory since at time t, it uses the past 
value of the input x( t - 1) . 


2 . 


Time-invariant? Yes. y x {t) = Sx(t-T) = 


x(t-T) 
l + x(t-l-T) 


= y(t-T). 
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3. Linear? No. The system S is nonlinear since it does not have the superpo- 
sition property: 


For x x {t), x 2 (t), let y x (t) = 


x,(t) 


l + Xjlt-l) 

Define x(t) = ax l (t)+bx 1 {t). 

Then v(t) = ‘“■ W + fa ’ ( ' ) - 


T 2 (0 = 


xJt) 


1 + X 2 ( t - 1) 
ax j ( ?) bx 2 (?) 


1 + ax t (? - 1) + bx 2 (? - 1) 1 + Xj ( ? - 1) 1 + x 2 ( t - 1) 


= ay ] (t) + by 2 (t) 


4. Causal? Yes. The system is causal, as the output is a function of the past 
and current values of the input x(t - 1) and x(t) only. 

5. Stable? No. For the bounded input x(t) = -1, Vt => | y(t)\ = that is, the 

output is unbounded. 

(c) y(t) = tx(t) 


Answer: 

1. Memoryless? Yes. The output at time t depends only on the current value 
of the input x(t). 

2. Time-invariant? No. y x {t) = Sx(t -T) = tx(t -T)*(t- T)x(t -T) = y(t - T). 

3. Linear? Yes. Let y^t) := Sx x (t) = tx x (t), y 2 (t) := Sx 2 (t) = tx 2 (t). Then, 

y(t) = S[ax x (t) + bx^it)] = t[ax x (t) + bx^it)] 

= atx x (?) + btx , (?) = ay x (?) + by 2 (?) 

4. Causal? Y es. The output at time ? depends on the present value of the input 
only. 

5. Stable? No. Consider the constant input x(?) = B => for any K, 3T such 
that I v(T)| = \tb\ > K , namely, T > A ; that is, the output is unbounded. 

(d) y[n]= ^ x[n-k] 

k — — °° 

Answer: 

1. Memoryless? No. The output y[n\ is computed using all future values of 

the input. o 

2. Time-invariant? Yes. y, [ n ] = Sx[n - fV] = ^ x[n -N-k] = y[n - A^] . 

k=-°° 
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3. Linear? Yes. Let y x [ri\ := SxJh] = ^ x 1 [n - k], 

k=- °o 

o 

y,[«] := 5 x 2 [»] = ^ x 2 [« - /c] . Then, the output of the system with 

k =- oo 

x[»] := ax x [«] + /fa 2 [w] is given by 

oo oo 

y\n\ = ^ x[« - k\ = ^ ax'j [n - k~\ + fix 2 [ n-k] = a ^ x 1 [n-k\ + [3 ^ x 2 \n-k] 

k =~ oo t=-»o k=—**> t=-» o 

= a.\’[«] + /3.v' 2 [«] 

4. Causal? No. The output y[o] depends on future values of the input *[« + |k|] . 


5. Stable? No. For the input signal x[n\ = 5, Vw => |y[n]| = 


S' 


£=- 




— +oo 


that is, the output is unbounded. 


Exercise 1.3 

Find the fundamental periods (T for continuous-time signals, N for discrete-time 
signals) of the following periodic signals. 

(a) x(T) = cos(137rt) + 2sin(47rt) 

Answer: 


x(t + T) = cos(\3nt + \3nT) + 2sm(4nt + 4nT) 


will equal x(t) if 3k, p s Z such that \3nT = 2nk, 4nT = 2np, which yields 

r = — = — => — = — . The numerator and denominator are coprime (no common 
13 2 ft 13 

divisor except 1); thus we take p = 4, k = 13, and the fundamental period is 

r = ^ = 2 
2 

(b) x[n\ = e jl35Un 


Answer: 

. 7 „. j™nn 7351 7351 

x[n ] = e jl ' " = e 1000 ; thus the frequency is - iooo 77- 2000 2?r anc * the num- 
ber 735 1 is prime, so the fundamental period is N = 20001 . 
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Exercise 1.4 

Sketch the signals x[n] = u[n + 3\-u[n\ + 0.5"u[n]-0.5"~ 4 u[n-4\ and y[n] = 
nu[-n\ - 8\n - 1] - nu[n — 3] + ( w — 4 )u[n - 6] . 

Answer: Signals x[n] and y[n] are sketched in Figure 1.55 and Figure 1.56. 



FIGURE 1.55 Signal x[n]. 


y[n] 



FIGURE 1.56 Signal y[n]. 


(b) Find expressions for the signals shown in Figure 1.57. 
Answer: 


2 2 

x(t) = — (t + 3 )u(t + 3) - — (t + 3 )u(t) - u(t ) + u(t -2) + 28{t + X)-8{t- 3) 
y(t) = X 2 (t - 3 k)u(t - 3 k) - 2 (t -3k- 1 )u(t -3k-\)~ 2 u(t -2-3 k) 
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Exercise 1.5 

Properties of even and odd signals. 

(a) Show that if x[n] is an odd signal, then ^ x[n ] = 0 . 

n=—oo 

Answer: 

For an odd signal, 

+oo -poo -poo 

x\n\ = -x[-«] => x[0] = 0 and ^ x[n ] = x[0] + ^(x[«] + x[-«]) = ^(x[»]-x[w]) = 0 

n=— oo n= 1 n= 1 

(b) Show that if X|[«] is odd and x 2 [«] is even, then their product is odd. 
Answer: 


x l [n] = -x 1 [-n], x 2 [n] = x 2 [-n] 
=> Xj [-n]x 2 [-»] = — jfj [«]x 2 [w] 


(c) Letx[«] be an arbitrary signal with even and odd parts x [«], x o [«] . Show 

-poo -poo -poo 

that ^ x 2 [n] = £ x/ [n] + X V M • 


«=— oo 


«=— oo 


«=— < 
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Answer: 


X * 2 M= X(* e M + * 0 M) 2= X x /M + 2 X uMu,M + X x 0 2 H 


n=-oo 


n=—oo 


n =— oo 



n=—oo 


+oo +oo 

= X x e 2 M + X *, 2 M 

«=— oo n=-oo 


(d) Similarly, show that 


+oo +oo +oo 

J x 2 (t)dt = J x 2 (t)dt + J x 2 (t)dt . 


Answer: 


J x 2 {t)dt = J (x e (t) + x o (t)) 2 dt = J x 2 (t)dt + 2 J x e (t)x o (t)dt + J x 2 (t)dt 



= J x 2 (t)dt+ | x 2 (t)dt 


Exercises 

Exercise 1.6 

Write the following complex signals in rectangular form: x(t) = a(t) + jb(t), a{t), 
b(t) e M for continuous-time signals and x[n] = a[n] + jb[n], a[n],b[n] e R for 
discrete-time signals. 

(a) x(t) = e ( - 2+ji) ‘ 

(b) x(t) = e~ jm u(t) + e a+JK), u(-t) 

Exercise 1.7 

Use the sampling property of the impulse to simplify the following expressions. 

(a) x(t) ~ e~‘ cos(10t)5(t) 

(b) x(t) = sin(2wt)^5(t - k) 

k = 0 

0 

(c) x[«] = cos(0.27T«)^ <5[« — 1 OA:] 

k=-~° 

Answer: 


ON THE CD 
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Exercise 1.8 

Compute the convolution S{t -T)* e~ 2, u(t) = J 8( z - T)e~ 2u ~ T) u(t - z)dz . 


Exercise 1.9 

Write the following complex signals in (i) polar form and (ii) rectangular form. 

Polar form: x(t) = r(t)e je(,) ,r(t),0{t) el for continuous-time signals and 
x\n\ = r[n]e jei ' l] , r[ri\,6[n\ e R for discrete-time signals. 

Rectangular form: x(t) = a(t) + jb(t), a(t),b(t ) e R for continuous-time sig- 
nals and x[n] = a[n] + jb[n], a[n],b[n] s R for discrete-time signals. 

(a) x x (t) = j + ~~~ 

(b) x 1 \n\ = jn + e' 2n 
Answer: 

ON THE CD 


Exercise 1.10 

Determine whether the following systems are (i) memoryless, (ii) time-invariant, 
(iii) linear, (iv) causal, or (v) BIBO stable. Justify your answers. 

(a) y(t) = —x(t), where the time derivative of x(t) is defined as 
dt 


d_ 

dt 


x(t) := lim 

Ar—>0 


x(t) — x(t — At) 
At 


(b) 


yif) = 


t 

1 + x(t — 1) 


(c) y(t) = 2tx(2t) 


n 

(d) y[n]=^x[k-n] 

k=-°° 

(e) y\n\ = x[n] + nx[n + 1] 

(f) y\n\ = x\n\ + x\n — 2] 
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Exercise 1.11 

Find the fundamental periods and fundamental frequencies of the following peri- 
odic signal. 

(a) x[n] = cos(O.Olnn)e j0l3K ” 

(b) x(t)= ^ e H, ~ 2k) cos[4n(t-2k))[u(t-2k)-u(t-2k-l)^. Sketch this 

i=-o o 

signal. 


Answer: 



ON THE CD 
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In This Chapter 

■ Discrete-Time LTI Systems: The Convolution Sum 

■ Continuous-Time LTI Systems: The Convolution Integral 

■ Properties of Linear Time-Invariant Systems 

■ Summary 

■ To Probe Further 

■ Exercises 


((Lecture 5: LTI Systems; Convolution Sum )) 

M any physical processes can be represented by, and successfully analyzed 
with, linear time-invariant (LTI) systems as models. For example, both a 
DC motor or a liquid mixing tank have constant dynamical behavior 
(time-invariant) and can be modeled by linear differential equations. Filter circuits 
designed with operational amplifiers are usually modeled as LTI systems for analy- 
sis. LTI models are also extremely useful for design. A process control engineer 
would typically design a level controller for the mixing tank based on a set of lin- 
earized, time-invariant differential equations. DC motors are often used in indus- 
trial robots and may be controlled using simple LTI controllers designed using LTI 
models of the motors and the robot. 
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DISCRETE-TIME LTI SYSTEMS: THE CONVOLUTION SUM 


It is arguably easier to introduce the concept of convolution in discrete time, which 
amounts to a sum, rather than in continuous time, where the convolution is an in- 
tegral. This is why we are starting the discussion of LTI systems in discrete time. 
We will see that the convolution sum is the mathematical relationship that links the 
input and output signals in any linear time-invariant discrete-time system. Given an 
LTI system and an input signal x[n\, the convolution sum will allow us to compute 
the corresponding output signal y [77] of the system. 

Representation of Discrete-Time Signals in Terms of Impulses 

A discrete-time signal x[»] can be viewed as a linear combination of time-shifted 
impulses: 

x[«] = ^ x\k~\8[n - k\ (2.1) 

k=-°° 

Example 2.1: The finite-support signal x[n] shown in Figure 2.1 is the sum of 

four impulses. 


I 


m 


2 < 
1 - 

\ < 
r 

i 

-3 -2 1-1 

0 1 : 

l 3 

i: 

-1 

-2 

n 




2 
1 ■ 

1 x[-l]£[w + 1 ] 

-3 -2 

-1 , 

■V 2 2 n 



■-2 

+ 


f x[0]£[/7] 


[op 2 3 
2 

x[l]S[n-l] 


|pl 2 3 
2 x\I\8\n-I\ 


0 12 3 
• -1 
■ -2 


FIGURE 2.1 Decomposition of a discrete-time signal as a sum of shifted 
impulses. 




Linear Time-Invariant Systems 55 


Thus the signal can be written as x[ri\ = -2 8[n + 1] + 28\n] + 8[n - 1] + 2 8[n - 2], 

Response of an LTI System as a Linear Combination of Impulse Responses 

We now turn our attention to the class of linear discrete-time systems to which the 
Principle of Superposition applies. 

By the Principle of Superposition, the response y\ri\ of a discrete-time linear 
system is the sum of the responses to the individual shifted impulses making up the 
input signal x[n\. 

Let h k [n] be the response of the LTI system to the shifted impulse 8[n - k ] . 

Example 2.2: For k = -4 , the response h [n] to 8[n + 4] might look like the 

one in Figure 2.2. 



FIGURE 2.2 Impulse response for an impulse 
occurring at time -4. 


Example 2.3: For the input signal x[n ] = -28[n + 1] + 2 8[n\ + 8[n - 1] + 2 8[n - 2] 

in Example 2.1, the response of a linear system would be y[n] = -2h fn] + 
2 h Q [n] + h x [«] + 2f [«] . 

Thus, the response to the input x[n] can be written as an infinite sum of all the 
impulse responses: 

y[n\= ^ x[k]h k [n]. ( 2 . 2 ) 

k=-oo 

If we knew the response of the system to each shifted impulse 8[n - k] , we 
would be able to calculate the response to any input signal x[n] using Equation 2.2. 
It gets better than this: for a linear time-invariant system (the time-invariance prop- 
erty is important here), the impulse responses h k [n\ are just shifted versions of the 
same impulse response for k = 0 : 
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h k [n\ = h 0 [n-k ] (2.3) 

Therefore, the impulse response h[n\ := h Q [n\ of an LTI system characterizes it 
completely. This is not the case for a linear time-varying system: one has to spec- 
ify all the impulse responses h k [n] (an infinite number) to characterize the system. 

Example 2.4: Consider the first-order constant-coefficient causal differential 

equation 


+ 3 y(t) = x(t) (2.4) 

at 

and assume the input signal x(t) is given. It is desired to compute the output 
signal y(t). Suppose that this differential equation is discretized in time in the 

following manner for simulation purposes: the derivative dyit) is approximated 

dt 

by ^ — — * — , where T is the time step (or the sampling period) and n T s , 

T s 

s 

n e Z is the discrete time at the sampling instant. Let y\n\ := y(nT), x[n] := x(nT s ). 
Equation 2.4 then becomes the discrete-time LTI system described by the follow- 
ing causal constant-coefficient difference equation: 

(l + 3T)y\n\-y[n-l\ = Tx[n\ (2.5) 

Its impulse response can be computed recursively with x[n ] = <5[«] and the ini- 
tial condition y[-l] = 0 : 


h[n ] = y[n] = 1 + 3J “>] + 

s 

h[0] = -P-h[-l\+ T 


1 + 3 T 
1 


1 + 3T 

S 

T 


h[ 1] = h[ 0] = 

1 + 3T (1 + 3T) 2 

h[2\ = -P-h[l\= T 


1 + 37 (1 + 37 ) 3 


T 

S 

1 + 3 T 

S 


S[n] 


T 

S 

1 + 3 T 


h[k] = 


T 

s 

(1 + 3 T) k+l 


( 2 . 6 ) 
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Hence, the impulse response of the discretized version of the differential equa- 
T 

tion is h\n\= u\ri\. It should become clear that this discrete-time system is 

(1 + 37X 1 

indeed time- invariant by computing by recursion its response to the impulse 
8[n - N] occurring at time N, with the initial condition y\N - 1] = 0 , which yields 

K [n\ = h[n-N\= ^ + ^ N+l u[n - N]. (2.7) 


The Convolution Sum 

If we substitute h[n-k\ for h k [n\ in Equation 2.2, we obtain the convolution sum 
that gives the response of a discrete-time LTI system to an arbitrary input. 

y[n\ = ^ x[k]h[n - k\ (2.8) 

k=-°° 

Remark: In general, for each time n, the summation for the single value y\ri\ 

runs over all values (an infinite number) of the input signal x[n] and of the impulse 
response h[n\. 

The Convolution Operation 

More generally, the convolution of two discrete-time signals v[n\ and w[n], denoted 
as v[n] * w {«] (or sometimes ( v * w)[n\ ), is defined as follows: 

v[h] * w[«] = ^ v[A:]m{« - k], (2.9) 

(t=^o 

The convolution operation has the following properties. It is 
■ Commutative: 

oo — oo +<x> 

v[«]*w[«]= ^ v[k\w[n - k\ = ^ v[n - m]w{m\ = ^ \\{m]v[n- m\ = w[n]*v[n] (2.10) 

k=-oo m=oo m=—oo 

(after the change of variables m = n — k ) 
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Associative: 

v[«] * ( w[«] * y\n\) = v[»] * ( y[n ] * w\ri\) 

+<X> 

= v[n ] * ^ - A:] 

k=-°° 

= ^ v[m] ^ -m-k\ 

m =-oo \ k=-oo 

+OQ +oo 

= ^ ^ v[Ar]v[w]l 4 {« - 272 - A:] 

m=—oo k=-°° 

= ^ j[A:]v[w2]h{« - 222 - A:] 

k=-oo m=—oo 
+oo +oo 

= ^ y[£] ^ v[m]w[n -k- 222] 

m=—oo 
+oo 

^ v[w2]w[« - 222] 


k=-oo m=—< 

^ +00 

= V[22] * 


y m= 


= y\n\ * ( v[27] * w[ 22 ]) = ( v[27] * w[ 22 ]) * y[27] (2.11) 


■ Distributive: 

+00 

X[22] * (v[22] + W[22]) = ^ x\k~\{ v\n ~ k] + w[22 - £]) 

k=-~° 

= ^ x[A:]v[22 - k] + ^ x[k]w[n - k] = x[2z]* v[2?] + x[2z]* 14(22] ( 2 . 12 ) 

k =^> o k=-°° 

■ Commutative with respect to multiplication by a scalar: 

a{v[n\ * w[22]) = (av[2?]) * ^[22] = v[2?] * (aw[22]) ( 2 . 13 ) 

■ Time-shifted when one of the two signals is time-shifted: 

v[ 27 ] * w[22 - N\ = ^ v\k\ w\n — N — k\ = (v * w)[n — N\ ( 2 . 14 ) 

i-=-~ 

■ Finally, the convolution of a signal with a unit impulse 8\n\ leaves the signal 
unchanged (this is just Equation 2.1), and therefore the LTI system defined by 
the impulse response h[n\ = 5[n\ is the identity system. 
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Graphical Computation of a Convolution 

One way to visualize the convolution sum of Equation 2.8 for simple examples is 
to draw the weighted and shifted impulse responses one above the other and to add 
them up. 

°o 2 

Example 2.5: Let us compute y[ri\= X x[k]h[n- k]= Y, { x[k]h[n - k] for the 

*=-~ k=0 , 

impulse response and input signal shown in Figure 2.3. 




n 


h[n\ 


I) 1 2 3 4 , 



• • • 


x[0]7?[/?] = 2 h[n\ 




p 1 2 3 4 n 

x[l]/ 2 [n - 1] = -3h[n - 1] 



x[2]h[n-2] 

2 - 


p t 

1 • 

; r ' 

L 

-4 -5 -2 -1 

► 

0 1 2 

• * 

} 4 n 



FIGURE 2.3 Graphical computation of a convolution. 


Another way to visualize the convolution sum is to draw the signals x\k\ and 
h[n - A:] as functions of k (for a fixed «), multiply them to form the signal g[/r], and 
then sum all values of g[k\ Both of these approaches to computing a convolution 
are included in the interactive Java Convolution applet on the companion CD- 
'mtmcd ROM (in D:\Applets\Convolution\SignalGraph\Convolution.html). 

Example 2.6: Let us compute y[0] and y[ 1 ] for the input signal and impulse re- 
sponse of an LTI system shown in Ligure 2.4. 
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FIGURE 2.4 Convolution of an input 
signal with an impulse response. 


Case n = 0: 

Step 1: Sketch x[k\ and h[0-k] = h[—k ] as in Figure 2.5. 



FIGURE 2.5 Impulse response 
flipped around the vertical axis. 
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Step 2: Multiply x[k\ and h[-k] to get g[k\ shown in Figure 2.6. 



FIGURE 2.6 Product of flipped impulse 
response with input signal for n = 0. 


Step 3: Sum all values ofg[£] from k = -°° to to gety[0]: 

y[ 0] = 3 

Case n = 1 : 

Step 1: Sketch x[k~\ and h[l - k] = h[-(k - 1)] (i.e., the signal h[-k ] delayed 
by 1) as in Figure 2.7. 



FIGURE 2.7 Time-reversed and shifted 
impulse response for n= 1. 
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Step 2: Multiply x\k] and h[\ - k] to get g\k\ shown in Figure 2.8. 


, 


gl*J 

3 - 

■ < 

1 

2 < 

► 


1 - 






-4 -3 -2 -1 

0 

1 2 3 4 k 


FIGURE 2.8 Product of flipped 
and shifted impulse response with 
input signal for n= 1. 


Step 3: Sum all values of g[k\ from k = to + 00 to gety[l]: 

y[l] = 2 + 3 = 5 



((Lecture 6: Convolution Sum and Convolution Integral)) 


Numerical Computation of a Convolution 


The numerical computation of a convolution sum y[n] = X x[k]h[n - k ] is illus- 

k=—°° ) 

trated by means of an example. Let us compute the response of an LTI system de- 


scribed by its impulse response: h[n ] = 
x[n\ shown in Figure 2.9. 


|(0.8)", 0<n<5 

I 0, otherwise 


to the input pulse signal 




FIGURE 2.9 Impulse response and input signal for numerical computation of a 
convolution. 


First, we sketch h[-k] and x\k], one above the other as shown in Figure 2. 10, 
taking care to indicate where time n is (here n = 0) as a label attached to the time- 
reversed impulse response. The label will move with the impulse response as 
h[-(k - n)] = h[n - k\ is shifted left or right as n changes. 
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>A-k\ 


. . T 1 

[J 

4 

1 

i 

1« 

► 

r 

f I f f ^ 

<1 1 
cx 1 

's/I 

1 

3 -2 -1 

0 1 2 3 4 ' t 



k 



1- 

4 

» 4 

» < 

> 

-7 -6 -5 -4 -3-2 -1 

0 

i : 

2 : 

5 4 5 6 7 , 

k 


FIGURE 2.10 Time-reversed impulse response and 
input signal for numerical computation of a convolution. 


Now, imagine grabbing the whole signal h[-k] in your hands and bringing it 
to k = -oo by making n — > -oo . Then, you gradually slide the signal back to the 
right by increasing n (as h[-(k-n)\ is a time delay by n of h[-k ] ), and you fig- 
ure out for what values of n the signals h[—(k — «)] and x[k] start to overlap. The 
overlapping intervals in time k are used as limits in the convolution sum. What is 
important to determine is for what values of n these limits change so that the cal- 
culation of the convolution effectively changes. 

In doing this for the above example, we find that the problem can be broken 
down into five intervals for n. 


For n < 0: There is no overlap, so x[k]h[n — k] is zero for all k, and hence 
y\n\ = 0 . This is the situation in Figure 2. 10. 

For 1 < n < 3 : There is some overlap as g[k] = x[k]h[n- k] ^0 for k = 1,...,«. 
The case n = 2 is shown in Figure 2. 1 1. 


We get 

y[n] = %[k] = ±mr k = (0.8)”X(0.8)- (m+1) = (0.8)' , - 1 X(0.8)- 


= ( 0 . 8 )" 


wo.s- 1 )^ 

1 -( 0 . 8) _1 


( 0 . 8)” -1 
- 0.2 


= 5 — 5(0.8)", 


(2.15) 


where we used the change of variable m = k- 1 . 



64 


Fundamentals of Signals and Systems 



FIGURE 2.1 1 Time-reversed and shifted impulse 
response for n = 2 with interval of overlap. 


For 4 < n < 6 : g[k ] = x[k]h[n - £] ^ 0 for k = 1,. . .,3 • The case n = 5 is shown 
in Figure 2.12. 



FIGURE 2.12 Time-reversed and shifted impulse 
response for n = 5 with interval of overlap. 
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We get 


y[n] = j^g[k] = £(0.8 r* = (0.8)"X(0.8)- (ffl+1) = (O.Sr'f (0.8)-" 

k = 1 k = 1 m = 0 m=0 


= ( 0 . 8)” -1 


"l-(0.8~') 3 " 
v l-(O.S )- 1 , 


( 0 . 8 )” ~( 0 . 8)”~ 3 
- 0.2 


= 5(0.8)”“ 3 -5(0.8)" =4.7656(0.8)", (2.16) 


where we used the change of variables m = k — 1. 

For 7<«<8: g[k] = x[k]h[n - k\ ^ 0 for n-5 < k <3 (see Figure 2.13). 



FIGURE 2.13 Time-reversed and shifted impulse 
response for n = 7 with interval of overlap. 


We have 


y[n]= X s[k]= £ (0.8)"-* =X(0.8)”- ( " 1+ "- 5) = (0.8) 5 X(0.8)- 


k=n- 5 


= ( 0 . 8) 5 


1 — ( 0 . 8) -1 


( 0 . 8) 6 -( 0 . 8 )” 
- 0.2 


■ = 5(0.8)” -3 -5(0.8) 6 , (2.17) 


where we used the change of variables m = k-(n- 5) . 

For «> 9 : the two signals x[A:], /;[«-£] do not overlap, so j[«] = 0. 
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In summary, the output signal y [77] of the LTI system as given by x[n]*h[n] 
is 


y[n] = \ 


0, 

n < 0 

5- 5(0.8)", 

1 < « < 3 

R 

oo 

1 1 n ' 
1 

00 

0 

| | 

4 < n < 6 

5(0.8)''“ 3 -5(0.8) 6 , 

7 < n < 8 

0 , 

n> 9 


which is sketched in Figure 2. 14. 


(2.18) 


1 



FIGURE 2.14 Output signal obtained by numerical 
computation of a convolution. 


The following MATLAB M-file located on the CD-ROM in D:\Chapter2\ 
DTconv.m computes the convolution between two discrete-time signals. 

%% DTconv.m computes the convolution of two discrete-time 

%% signals and plots the resulting signal 

% define the signals 

% first value is for time n=0 

x — [ 1 4 -3 -2 -1 ] ; 

h= [2 222-3-3-3 -3 -3] ; 

% compute the convolution 
y=conv(x,h) ; 

% time vector 
n=0: 1 :length(y) -1 ; 

%plot real and imaginary parts 
stem(n,y) 



Linear Time-Invariant Systems 67 


CONTINUOUS-TIME LTI SYSTEMS: THE CONVOLUTION INTEGRAL 


In much the same way as for discrete-time systems, the response of a continuous- 
time LTI system can be computed by a convolution of the system’s impulse re- 
sponse with the input signal, using a convolution integral rather than a sum. 

Representation of Continuous-Time Signals in Terms of Impulses 

A continuous-time signal x(t) can be viewed as a linear combination of a contin- 
uum of impulses (an uncountable set of impulses infinitely close to one another): 

+oo 

x(t)= j x(z)8(t-z)dz (2.19) 

We arrive at this result by “chopping up” the signal x( t) in sections of width A 
as shown in Figure 2.15 and taking the sum in Equation 2.20 to an integral as 
A — > 0 . 



FIGURE 2.15 Staircase approximation to a 
continuous-time signal. 


Recalling our definition of the unit pulse 5 A (t) (width A and height A -1 ), we 
can define a signal x(t) as a linear combination of delayed pulses of height x(kA) 
(each rectangular section in the above plot.) 

x(t) := ^ x(kA) S A (t — £A)A (2.20) 

Taking the limit as A — > 0 , we obtain the integral of Equation 2.19 above. 
Remarks: AsA->0, 

■ The summation approaches an integral. 

■ M->t,so r(M)->x(r). 
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■ A—>dz. 

■ 5jt-kA)->8(t- z). 

Equation 2. 19 can also be arrived at by using the sampling property of the im- 
pulse function. If we consider t to be fixed and x to be the time variable, then we 
have 


sampling property 

x(z )S(t - t) = x(z)S(-(z - 1)) = x(z)8(z -t)= x(t)S( z - 1) (2.21) 

as 8(t)=8(-t ) 


Hence, 


J x(z)8(t - z)dz = J x(t)S(z -t)dz = x(t) J 8(z - t)dz =x{t) 


( 2 . 22 ) 


Impulse Response and the Convolution Integral Representation 
of a Continuous-Time LTI System 

The linearity property of an LTI system allows us to apply the Principle of Super- 
position to calculate the system’s response to the piecewise-constant input signal 
x(t) defined previously. Let h kA (t) be the “pulse responses” of the linear time- 
varying system S to the unit area pulses S A (t - kA) for -« <k <+°°. Then, by 
linearity, the response of S to x(t) is simply given by 

K 0 := X x(kA)h kA (t)A (2.23) 

i=-= o 

Note that the response h kA (t) tends to the impulse response h (t ) (corre- 
sponding to an impulse at time x) as A — » 0 . Then, at the limit, we get the response 
of system S to the input signal x(t) = limx(Z) : 

A— >0 

Too 

y(t) = \imy(t)= [ x(z)h (t)dz (2.24) 

A— >0 ^ J T 


For an LTI (not time-varying) system S, the impulse responses h T (t) are all the 
same as \(t), except that they are shifted by x, just like the discrete-time case. We 
define the unit impulse response ( or impulse response for short) of the LTI system 
S as follows: 


h{t) \= h 0 (t ) 


(2.25) 
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Then, the response of the LTI system S is given by the convolution 
integral 

+oo 

y(t) = J x(z )h(t - z)dz (2.26) 

Note that an LTI system is completely determined by its impulse response. 

The Convolution Operation 

Recall that we defined the convolution operation for discrete-time signals in the 
previous section. The convolution operation for continuous-time signals is defined 
in an analogous manner. The convolution of v(t) and w(t), denoted as v(t) * w{t), 
or sometimes (v * w)(t) , is defined as follows: 

+oo 

v(t)*w(t) = J v(z)w(t-z)dz (2.27) 

Just like the discrete-time case, the convolution operation is (check as an 
exercise): 

■ Commutative: v(t) * w(t) = w(t ) * v{t) 

■ Associative: [r(0*v(0]*w(0 = K0*[ v (0* w (0] 

■ Distributive: r(t)*[v(t) + w(t)~j = r(t)*v(t) + r(t)*w(t) 

■ Commutative with respect to multiplication by a scalar: j^av(t)] * w(t) = 
v(t) * [aw(t)] = a[v(t) * w(t)] 

■ Finally, the convolution of any signal with a unit impulse leaves the signal un- 
changed: v(t) * 8(t) = v(t). Flence, if the impulse response of an LTI system is 
the unit impulse, then this system is the identity system. This is expressed in 
Equation 2.19. 



((Lecture 7: Convolution Integral )) 


Calculation of the Convolution Integral 

The calculation of a convolution integral is very similar to the calculation of a con- 
volution sum. To evaluate the integral in Equation 2.26 for a specific value of t, we 
first obtain the signal h(t - z) viewed as a function of T, then we multiply it by x(x) 
to obtain the function g(x), and finally we integrate g(x) to gety(t). 
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We now introduce a method to obtain the graph of h(t - z) from the graph of 

A(t): 

Step 1: Sketch the time-reversed impulse response h(—z). This involves 

flipping the graph of h( x) around the vertical axis. 

Step 2: Then, shift this new function to the right by t (time delay) for t > 0 to 

obtain h{-( z - 1 )) = h(t - z), or to the left by 1 1 | (time advance) for t < 0 to 
obtain /z(-(t + |f|)) = h(t-z). 

This method has the advantage of always starting from a single sketch of 

hi~z). 

Example 2.7: Given h(z) in Figure 2. 16, sketch h(t - z) for t = — 2 and t = 2. 

Time reversal is shown in Figure 2. 17, and the shifts to the left for t = —2 and 
to the right for t = 2 are shown in Figure 2.18 and Figure 2.19, respectively. 



FIGURE 2.16 Impulse 
response of a continuous- 
time system. 


A K-T) 



-2 2 r 

FIGURE 2.17 Time-reversed 
impulse response. 


f *Hr+M))| 



-4 1 x 


t—2 


= h(-2 - r) 


f A(-(r-0)U =H2~r) 



> 

T 


FIGURE 2.18 Time-reversed impulse 
response shifted to the left. 


FIGURE 2.19 Time-reversed 
impulse response shifted to the 
right. 
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Remark: A convolution being commutative, sometimes it proves easier to work 

with h{%) and x(t - z) , instead of x(l) and h(t - z) . 

Now, we look at a convolution example. We will compute the response 
of a continuous-time LTI system described by its impulse response 
h{t) = e~ a, u(t), a > 0 to the step input signal x(t) = u(t) , as shown in Figure 2.20. 

Sketch h(-z) as in Figure 2.21. 

Immediately, we see that for t < 0 in Figure 2.22, the two signals x(z) and 
h(t-z) do not overlap, so g{z) = x(z)h(t-z) = 0 and hence, y(t ) = 0 for t < 0. 

However, for t> 0 , the two functions overlap, as can be seen in Figure 2.23, 
and g( z) = x(z)h(t - z) 0 for 0 < z < t . 



FIGURE 2.20 Exponential impulse response and unit step input to 
be convolved. 



FIGURE 2.21 Time-reversed 
impulse response. 



FIGURE 2.22 Time-reversed 
impulse response shifted to 
the left for negative times. 


M-(r-O) 



FIGURE 2.23 Time- 
reversed impulse response 
shifted to the right for 
positive times. 
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Finally, combining the results for t < 0 and t > 0, we get the response 

y(t) = -(\-e~ al )u(t), -°°<t< oo, (2.29) 

a 

Since “practice makes perfect,” let us look at a second example. 

Example 2.8: We want to calculate the response of the continuous-time LTI 

system described by its impulse response h(t) = u(t + 1) to the input signal 
x(t) = -e 2(t ~ l) u(-(t - 1)) (see Figure 2.24). 


h(j) f - v ( r ) 



1 


1 

— 

\ 

T 

-1 

0 

T 

-1 - 


FIGURE 2.24 Impulse response and input signal to be convolved. 


The time-reversed impulse response h{— t) is plotted in Figure 2.25. 

We can see from Figure 2.26 and Figure 2.24 that there are two distinct cases: 
for t < 0, the two functions overlap over the interval — °° < x < t + 1 . 



1 



k h(t — r) for t, < -1 

i 


-1 

► 

T 


t+ 1-1 T 


FIGURE 2.25 Time-reversed 
impulse response. 


FIGURE 2.26 Time-reversed 
impulse response shifted to the left. 
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h(t - t) for 



1 

t> 0 





t + 1 j 


FIGURE 2.27 Time-reversed impulse 
response shifted to the right. 


For? > 0 the two functions overlap over the fixed interval — 
ure 2.27). Thus, for t < 0, we get 

Too f + 1 

y(t) = J g(?)dT = J g(T)dx 

t + 1 

= J x(z)h(t-z)dz 

t+\ i i 

= \-e 2 ^dx = --[e 2, -0\ = --e- 


and for t > 0 we get 


y( 0 = j g(*)dT = j g(T)dz 

1 

= J x(z)h(t-z)dz 

= \-e 1 ^ ) dx = --[e°-0] = - 


Piecing the two intervals together we obtain the response 
y{t) = -^e 2, u(-t)-^u(t) 


< z < 1 (see Fig- 


(2.30) 


(2.31) 


(2.32) 


This sum of two signals forming the output is illustrated in Figure 2.28. 
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FIGURE 2.28 Overall response of the LTI system 
as a sum of two signals. 



((Lecture 8: Properties of LTI Systems)) 


PROPERTIES OF LINEAR TIME-INVARIANT SYSTEMS 


LTI systems are completely characterized by their impulse response (a nonlinear 
system is not). It should be no surprise that their properties are also characterized 
by their impulse response. 

The Commutative Property of LTI Systems 

The output of an LTI system with input x and impulse response h is identical to the 
output of an LTI system with input h and impulse response x, as suggested by the 
block diagrams in Figure 2.29. This results from the fact that a convolution is com- 
mutative, as we have already seen. 
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y\n\ = ^ x[k]h[n — k]=^ h[k\x[n - k\ 

k=—oo k=—oo 

y(t) = | x(T)h(t - z)dz = | h(z)x(t-z)dz 


(2.33) 

(2.34) 



FIGURE 2.29 Equivalent block diagrams 
of LTI systems with respect to the output. 


The Distributive Property of LTI Systems 

The distributive property of LTI systems comes from the fact that a convolution is 
distributive: 


x*(h l + h 2 ) = x*h l +x*h 2 (2.35) 

which means that summing the outputs of two systems subjected to the same input 
is equivalent to a system with an impulse response equal to the sum of the impulse 
responses of the two individual systems, as shown in Figure 2.30. 



FIGURE 2.30 System equivalent to a 
parallel interconnection of LTI systems. 
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Application: The distributive property sometimes facilitates the evaluation of a 

convolution integral. 


Example 2.9: Suppose we want to calculate the output of an LTI system with 

f i Y 

impulse response h[n] = ^ u[n] + 4"u[-n] to the input signal x[n] = u[n]; it is 


easier to break down h[n] as a sum of its two components, 

h 2 [n] = 4"u[-n], then calculate the two convolutions 
y 2 [n\ = x [n\* h 2 [n] and sum them to obtainylyi]. 



u[n] and 


y x [n\ = x[n\*\[n\. 


The Associative Property of LTI Systems 

The associative property of LTI systems comes from the convolution operation 
being associative. 


y = (x*h l )*h 2 =x*(h l *h 2 ) (2.36) 

This implies that a cascade of two (or more) LTI systems can be reduced to a 
single system with impulse response equal to the convolution of the impulse re- 
sponses of the cascaded systems. Furthermore, from the commutative property, the 
order of the systems in the cascade can be modified without changing the impulse 
response of the overall system. 



FIGURE 2.31 System equivalent 
to a cascade interconnection of 
LTI systems. 


Application: A bandpass filter design problem is sometimes approached in two 

stages, where a first filter stage with impulse response h lo s (t) would filter out 
the high frequencies in the input signal, while a high-pass stage with impulse re- 
sponse h h (t) would filter out the low frequencies and DC component of the 
input signal. Once the two stages are designed (i.e., their impulse responses have 
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been determined), they are combined together as h,., (t) := h, (t) * h, ( t ) for 
a more efficient implementation as an op-amp circuit (one may be able to save a 
few op-amps while reducing the potential sources of noise). 

LTI Systems Without Memory 

Recall that a system S is memoryless if its output at any time depends only on the 
value of its input at that same time. 

For an LTI system, this property can only hold if its impulse response is itself 
an impulse, as is easily seen from the convolution Equations 2.8 and 2.26. When 
h[n] and hit) are impulses, h[n-k] and h(t — t) are nonzero only for k = n and 
T = t , and then y\n\ = x[«]/?[0] and 

t + t + t + 

y(t ) = | x(z )h(t - z)dz = J x(z)A8(-(z - t))dz = Ax(t)j 8(z - t)dz = Ax(t) (2.37) 

r r r 

Thus, to be memoryless, a continuous-time LTI system must have an impulse 
response of the form h{t) = A5(t), and a discrete-time LTI system must have an im- 
pulse response of the form h[n ] = A8[n\ . The LTI system has memory otherwise. 

Invertibility of LTI Systems 

We have already seen that a system S is invertible if and only if there exists an in- 
verse system 5 _1 for it such that S~ l S is the identity system. 

For an LTI system with impulse response h, this is equivalent to the existence 
of another system with impulse response \ such that h*h { = 8 , as shown in Fig- 
ure 2.32. 



FIGURE 2.32 Cascade of an LTI 
system and its inverse. 


Application: For low-distortion transmission of a signal over a communication 

channel (telephone line, TV cable, radio link), the signal at the receiving end is 
often processed through a filter whose impulse response is designed to be the in- 
verse of the impulse response of the communication channel. 
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Example 2.10: A system with impulse response h(t) = 8{t-T) delays its input 

signal by time T. Its inverse system is a time advance of T with impulse response 
\{t) = 8(t + T) , as we now show. (Here we make use of the sampling property of 
the impulse function and we use the fact that S(t) = 8(-t).) 

+oo Too 

h(t)*h l (t)= J h(x)h l (t-x)dx = J 8(z - T)8(t - z + T)dz 

= J 8(z - T)8(-( z - 1 - T))dx = J S(z - T)8(z -t-T)dz 

= J S(z - T)8(z - (t + T))dz = 8(t + T- T) J S(z ~(t + T))dz 
= 8(t ) (2.38) 

Causality of an LTI System 

Recall that a system is causal if its output depends only on past and/or present val- 
ues of the input signal. Specifically, for a discrete-time LTI system, this require- 
ment is that y\n\ should not depend on x[k] for k > n. Thus, looking back at the 
convolution sum in Equation 2.8, the impulse response should satisfy h[n - k] = 0 
for k > n, which is equivalent to h[k ] = 0 for k < 0. Therefore, a discrete-time LTI 
system is causal if and only if its impulse response is zero for negative times. This 
makes sense, as a causal system should not exhibit a response before the impulse 
is applied at time n = 0. 

A similar analysis for a continuous-time LTI system leads us to the same con- 
clusion. Namely, a continuous-time LTI system is causal if and only if 
h(t ) = 0, t < 0 . 

Example 2.11: A linear time-invariant circuit is causal. In fact, virtually all phys- 

ical systems are causal since it is impossible for them to predict the future. 

BIBO Stability of LTI Systems 

Recall that a system is BIBO stable if for every bounded input, the output is also 
bounded. Let us consider a discrete-time system with impulse response h[n]. As- 
sume that the discrete-time signal x[n] is bounded by B for all n. Then, the magni- 
tude of the system’s output can be bounded using the triangle inequality as follows: 
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\y\n\\ = 


^ x[k]h[n- k] 


k =- oo 


A^= — OO k =- oo 


(2.39) 


and we conclude that if X |/z[£]| < +°° , then | y- [ « ] | is bounded and the LTI system 

is stable. It turns out that this condition on the impulse response is also necessary 

for BIBO stability, as we now show. Suppose that Y \h[k\ = +°° . Then we can 

construct an input signal using the so-called signum function x[k] = sgn (h[-k]) = 

I 1, h[-k] > 0 s which is bounded by 1 and leads to an output that is unbounded at 
[-1, h[-k] < 0 

n = 0: 


y 


[0]| = 


£ x[k]h[-k] 


£ sgn(h[-k])h[-k] 


= h[k ] | = +°° (2.40) 


Therefore, a discrete-time LTI system is BIBO stable if and only if 

+<» - - 

Y \h[k]\ < -H=o , that is, the impulse response must be absolutely summable. 

k=-oc 

The same analysis applies to continuous-time LTI systems for which BIBO 

+oo 

stability is equivalent to J |/;(T)|r/T < +°°, that is, for which the impulse response 
is absolutely integrable. 


Example 2.12: The discrete-time system with impulse response h[n ] = - u[n - 1] 

w n 

N 1 

is unstable because Y- does not converge as N 

n = 1 n 

t 

Example 2.13: Is the continuous-time integrator system y(t)= J x( x)dx stable? 

t 

Let us calculate its impulse response first: h(t)= J S(T)c/z = u(t), the unit step. A 
unit step is not absolutely integrable, so the system is unstable. 

The Unit Step Response of an LTI System 

The step response of an LTI system is simply the response of the system to a unit 
step. It conveys a lot of information about the system. For a discrete-time system 
with impulse response h[n], the step response is s[n] = u[n\*h[n] = h[n]*u[n]. 
This convolution can be interpreted as the response of the accumulator system 



80 


Fundamentals of Signals and Systems 


with impulse response u[n\ to the signal h[n\. Hence, the step response of a discrete- 
time LTI system is just the running sum of its impulse response: 

s[n] = f^h[k]. (2.41) 

Conversely, the impulse response of the system is the output of the first- 
difference system with the step response as the input: 

h\n] = s\n] — s\n — \\. (2.42) 

For a continuous-time system with impulse response hit), the step response is 
s(t) = u(t)*h(t) = h(t)*u(t). This convolution can also be interpreted as the re- 
sponse of the integrator system with impulse response u(t) to the signal h(t). Again, 
the step response of a continuous-time LTI system is just the running integral of its 
impulse response: 

t 

s(t ) = J h(T)dz. (2.43) 

Conversely, the first-order differentation system (the inverse system of the in- 
tegrator), applied to the step response, yields the impulse response of the system: 

h{t) = —sit). (2.44) 

dt 

Example 2.14: The impulse response and the step response of the RC 

circuit of Figure 2.33 are shown in Figure 2.34. 

t vJ0 = >/(t) 




FIGURE 2.33 Setup for step response of an RC circuit. 



O V oJt) = s ( 0 



FIGURE 2.34 Impulse response and step response of the RC circuit. 
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SUMMARY 


In this chapter, we have studied linear time-invariant systems. 

■ An LTI system is completely characterized by its impulse response. 

■ The input-output relationship of an LTI discrete-time system is given by the 
convolution sum of the system’s impulse response with the input signal. 

■ The input-output relationship of an LTI continuous-time system is given by the 
convolution integral of the system’s impulse response with the input signal. 

■ Given the impulse response of an LTI system and a specific input signal, the 
convolution giving the output signal can be computed using a graphical ap- 
proach or a numerical approach. 

■ The main properties of an LTI system were derived in terms of its impulse 
response. 


TO PROBE FURTHER 


For a more detailed presentation of linear time-invariant and time-varying systems, 
including multi-input multi-output systems, see Chen, 1999. 


EXERCISES 

Exercises with Solutions 

Exercise 2.1 

Compute the convolutions y[n\ = x[ri\ * h[n ] : 

(a) x[n ] = a"u[n], h[n] = f5"u[n], a ^ [5 . Sketch the output signal y\n\ for 
the case a. = 0.8, /I = 0.9. 


Answer: 


y[n] = ^ x[k]h[n-k\ 

k=-°° 


= ^ a k n\k]fi" k u[n-k ] 




( \ k 

1 a 


k=0 


J 


, n > 0 
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= j8" 


1- 


' a ^ 

Jj 


1 - 


' a ^ 

Jj 


_ f p n+l - a n+l ^ 
v P-a 

For a = 0.8, f5 = 0.9 , we obtain 


m[«] 


m[«], a & P 


y[n] = 


(0.9)" +1 -(0.8) ,,+n 

0.1 


«[«] = [9(0.9)''- 8(0.8)" ]«[«] 


which is plotted in Figure 2.35. 


y[n] 



FIGURE 2.35 Output of discrete-time LTI system 
obtained by convolution in Exercise 2.1(a). 


(b) x\ri\ = 8[ri\ — 8\n — 2], h[n] = u[n\ 

Answer: 

y[n\= ^ x[k]h[n-k\= ^ (8[k\- 8[k-l^u[n- k\ = u[n] - u[n - 2], 

(c) The input signal and impulse response depicted in Figure 2.36. Sketch the 
output signal y\n\. 


Answer: 

Let us compute this one by time -reversing and shifting x[k\ (note that time- 
reversing and shifting h[k] would lead to the same answer) as shown in Figure 2.37. 
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-4 - 3-2 -1 0 1 2 3 4 5 6 7 8 9 10 k 

FIGURE 2.36 Input signal and impulse i 

response in Problem 2.1(c). 

FIGURE 2.37 Time-reversing and shifting the 
input signal to compute the convolution in 
Exercise 2.1 (c). 


Intervals: 


n <2 

h[k]x[k-n] = 0, V* 

O 

II 

< g | 

2 < « < 4 : 

h[k]x[k - «] = 1, 2<k <n 

n 

y[n] = ^ 1 = n — (2) + 1 = n — 1 

k= 2 

5 < n < 7 : 

h[k]x[k -n\ = l,n-2<k<n 

n 

y\n]= X 1 = 3 

k—n—2 

8 < n < 9 : 

h[k]x[k -n\=\,n-2<k<l 

7 

y[n\= ^ 1 = 7 — ( w — 2) + 1 = 10 

k-n-2 

n > 10 

h[k]x[k-n] = 0, V* 

O 

II 

| g | 


Figure 2.38 shows a plot of the output signal: 



FIGURE 2.38 Output of discrete-time LTI system 
obtained by convolution in Exercise 2.1(c). 
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(d) x[n\ = u[n], h[n\ = u[n ] 


Answer: 


y\ri\ = x[k]h[n-k] 

k=-°° 

= ^ u[k]u[n - k] 

k =-<> o 

+00 

= ^ u[k]u[-(k - «)] 


t-=- 


^ 1 = 77 + 1, 77 > 0 


t-=o 


0, 77 < 0 

= (77 + 1) m [77] 


Exercise 2.2 

Compute and sketch the output y(t) of the continuous-time LTI system with im- 
pulse response h(t) for an input signal x(t) as depicted in Figure 2.39. 



FIGURE 2.39 Input signal and impulse response in 
Exercise 2.2. 
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Answer: Let us time-reverse and shift the impulse response. The intervals of inter- 
est are 

t < 1 : no overlap as seen in Figure 2.40, so y(t) = 0 . 



FIGURE 2.40 Time-reversed and shifted impulse response and 
input signal do not overlap for t< 1, Exercise 2.2. 


1 < t < 4 : overlap for 0 < z < t - 1 as shown in Figure 2.41. Then, 


t - i 


t - i 


y(t)= J h(t - z)x(z)dz = J e <( T l) dz = t 




t - i 


= (\-e~ <, ~ l> ), l<t<4 



FIGURE 2.41 Overlap between the impulse response and the 
input for 1 < f < 4 in Exercise 2.2. 
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t> 4: overlap for 0 < T < 3 as shown in Figure 2.42. Then, 


j j 

y(t) = J h(t - T)x(T)ch = J e~ (, ~ T ~ l) dT = < 


-(f-T-i) 


= (e 4_r - e~') = (e 4 - e l )e~' , t> 4 


4 1 \ -t 



FIGURE 2.42 Overlap between the impulse response and the 
input for t > 4 in Exercise 2.2. 


Finally, the output signal shown in Figure 2.43 can be written as follows: 



FIGURE 2.43 Output signal in Exercise 2.2. 
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Exercises 

Exercise 2.3 

Compute the output y(t) of the continuous-time LTI system with impulse response 
h(t) = u(t + 1) - u(t - 1) subjected to the input signal x(t) = u(t + 1) - u(t - 1) . 


Answer: 



ON THE CD 


Exercise 2.4 

Determine whether the discrete-time 
h[n] = (-0.9)" u[n - 4] is BIBO stable. Is 

Exercise 2.5 

Compute the step response of the 
h( t) = e~‘ cos(2 t)u(t). 

Answer: 

ON THE CD 


LTI 

system 

with 

impulse 

response 

it causal? 




LTI 

system 

with 

impulse 

response 


Exercise 2.6 

Compute the output y(t) of the continuous-time LTI system with impulse response 
h(t) for an input signal x(t) as depicted in Figure 2.44. 



FIGURE 2.44 Impulse response and input signal 
in Exercise 2.6. 
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Exercise 2.7 

Compute the convolutions y[n] = x[n \ * h[n ] . 

(a) The input signal x[n] and impulse response h[n ] are depicted in Figure 
2.45. Sketch the output signal y\n\. 




1 x[n] 


> 1 

> 1 • 

» • 





-4 -3 -2 

l 

i : 

l 3 4 5 n 


.. ,‘T 

k 

►3 

2 i 

h 

» i 

1"1 

» 

-4 -3 -2 -1 

1 2 3 4 5 n 


FIGURE 2.45 Input signal and impulse response 
in Exercise 2.7. 


(b) x[n] = u[n] - u[n - 4], h[n] = u[n + 4] - u[n\ . Sketch the input signal x\n\, 
the impulse response h[n], and the output signal v[ ,; ]- 


Answer: 



ON THE CD 


Exercise 2.8 

Compute and sketch the output y(t) of the continuous-time LTI system with im- 
pulse response h(t) for an input signal x(t) as depicted in Figure 2.46. 

Exercise 2.9 

Compute the response of an LTI system described by its impulse response h[n] = 

(( 0 . 8 )", 0<n <5 

1 . to the input signal shown m Figure 2.47. 

| 0, otherwise r o a 
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FIGURE 2.46 Impulse response and input signal in 
Exercise 2.8. 


1 


xp, 

Ll 

d ; 

• 

k 

> 

m 
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-1 

12 4 4 5 n -1 

i ^ 

•3 4 5 6 7 n 


FIGURE 2.47 Input signal and impulse response in Exercise 2.9. 


Answer: 



ON THE CD 


Problem 2.10 

The input signal of the LTI system shown in Figure 2.48 is the following: 
x(t) = u(t) — u(t — 2) + S(t + 1) 

The impulse responses of the subsystems are \{t) = e~'u(t), h,(t) = e~ 2, u(t ) . 

(a) Compute the impulse response h(t) of the overall system. 

(b) Find an equivalent system (same impulse response) configured as a paral- 
lel interconnection of two LTI subsystems. 

(c) Sketch the input signal x(t). Compute the output signal y(t). 
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}'(t) 


FIGURE 2.48 Cascaded LTI systems in Exercise 2.10. 
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((Lecture 9: Definition of Differential and Difference Systems)) 

D ifferential and difference linear time-invariant (LTI) systems constitute an 
extremely important class of systems in engineering. They are used in cir- 
cuit analysis, filter design, controller design, process modeling, and in 
many other applications. We will review the classical solution approach for such 
systems. Figure 3.1 shows that differential systems form a subset of the set of con- 
tinuous-time LTI systems. A consequence of this set diagram is that any differen- 
tial system has an impulse response. The same is true for difference systems. We 
will show techniques to compute their impulse response. 
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FIGURE 3.1 Differential systems form a subset of 
continuous-time LTI systems. 


CAUSAL LTI SYSTEMS DESCRIBED BY 
DIFFERENTIAL EQUATIONS 


Differential systems form the class of systems for which the input and output sig- 
nals are related implicitly through a linear, constant coefficient ordinary differen- 
tial equation. Note that partial differential equations, such as the heat equation, are 
excluded here, as they represent distributed-parameter or infinite-dimensional 
systems, which are out of the scope of this book. 

Example 3.1 : Consider a first-order differential equation relating the input x(t) to 

the output y(t): 


1000^^ + 300y(0 = x(0 (3.1) 

dt 

This equation could represent the evolution of the velocity y(t) in meters per 
second of a car of mass m = 1000 kg, subjected to an aerodynamic drag force pro- 
portional to its speed Dy(t), where D = 300 ^ and in which x(t) is the tractive 
force in newtons applied on the car (Figure 3.2). According to Newton’s law, the 
sum of forces accelerates the car so that we can write m = —Dy(t) + x(t) , where 
the derivative of the velocity d '^ 1 is the car’s acceleration. Rearranging this equa- 
tion, we obtain Equation 3.1. Note that the aerodynamic drag force is more typi- 
cally modeled as being proportional to the square of the velocity of the vehicle, but 
this leads to a nonlinear differential equation, which is beyond the scope of this 
book. A version of the car’s dynamics linearized around an operating velocity, such 
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as given in Equation 3.1, would often be used in a preliminary analysis. Given the 
input signal x{t), that is, the tractive force, we would normally have to solve the dif- 
ferential equation to obtain the output signal (the response) of the system, that is, 
the speed of the car. 



► 


*(0 


FIGURE 3.2 Forces acting on a car. 


In general, an W'-ordcr linear constant coefficient differential equation has the 
form 


^ d k y(t) ^ , d k x(t) 

_ 2A , k 

k=0 Ui k = 0 UL 


(3.2) 


which can be expanded to 


d N y(t) 

dt N 


H h Cl, 


dy(t) 

dt 


+ a 0 y(t) = b A 


d M x(t ) 
dt M 


■ + h 


dx(t) 

dt 


+ b Q x{t). (3.3) 


The constant coefficients {a.}’ and {ft,} ” are assumed to be real, and some of 
them may be equal to zero, although it is assumed that a N ^ 0 without loss of gen- 
erality. The order of the differential equation is defined as the order of the highest 
derivative of the output present in the equation. To find a solution to a differential 
equation of this form, we need more information than the equation provides. We 
need N initial conditions (or auxiliary conditions) on the output variable y(t) and its 
derivatives to be able to calculate a solution. 

Recall from previous math courses that the complete solution to Equation 3.2 
is given by the sum of the homogeneous solution of the differential equation (a 
solution with the input signal set to zero) and of a particular solution (an output 
signal that satisfies the differential equation), also called the forced response of the 
system. 

The usual terminology is as follows: 


■ Forced response of the system = particular solution (usually has the same form 
as the input signal) 
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■ Natural response of the system = homogeneous solution (depends on initial 
conditions and forced response) 

A few authors use the term forced response as meaning the system’s response 
to the input with zero initial conditions. However, in this book, and in most of the 
relevant literature, such a response is called a zero-state response (more on this 
later.) 

Example 3.2: Consider the LTI system described by the causal linear constant 

coefficient differential Equation 3.1. We will calculate the output of this system, 
that is, the car velocity, from a standstill, to the input tractive force signal 
x(t) = 5000 e~ 2 'u(t) N . This input signal could correspond to the driver stepping 
on the gas pedal from a standstill and then rapidly easing the throttle. As stated 
above, the solution is composed of a homogeneous response (natural response) and 
a particular solution (forced response) of the system: 

y(t) = y h (t) + y p (t\ (3.4) 

where the particular solution satisfies Equation 3.1, and the homogeneous solution 
y h {t) satisfies 


dy, ( t ) 

1000^-^ + 300^(0 = 0. (3.5) 

Step 1: For the particular solution for t > 0, we consider a signal y p (t) of the 

same form as x(t) for t> 0: y p (t) = Ce~ 2 ' , where coefficient C e R is to be de- 
termined. Substituting the exponentials forx(t) and y p (t) in Equation 3.1, we 
get 


-2000Ce“ 2 ' +300Ce -2 ' = 5000A 2 ', (3.6) 

which simplifies to -2000C + 300C = 5000 and yields C = - 50< %, 00 = -2.941. 
Thus, we have 

y p (t) = -2.94 le“ 2 ', t> 0. (3.7) 

Remark: The particular solution seems to indicate a negative velocity, that is, 

the car moving backward, which would not make sense, but the full solution needs 
to be considered, not just the particular solution. 
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Step 2 : Now we want to determine yi,(t), the natural response of the system. 

We assume a solution of the form of an exponential: y h {t) = Ae'\ where A ± 0 . 

Substituting this exponential into Equation 3.5, we get 

0 = \000 Ase sl + 300 Ae s ' = A(\000s + 300)e s ‘ , (3.8) 

which simplifies to s + 0.3 = 0. This equation holds for s = -0.3. Also, with 

this value for s, Ae~°' 31 is a solution to the homogeneous Equation 3.5 for any 

choice of A. 

Combining the natural response and the forced response, we find the solution 
to the differential Equation 3.1: 

y(t) = y h (t) + y p (t) = Ae~ 03 ‘ -2.94le~ 21 , t > 0. (3.9) 

Now, because we have not yet specified an initial condition ony(f), this re- 
sponse is not completely determined, as the value of A is still u nk nown. 

Strictly speaking, for causal LTI systems defined by linear constant-coefficient 
differential equations, the initial conditions must be y( 0) = =■■■= v_ ( , 0> = 0 , 

what is called initial rest. That is, if at least one initial condition is nonzero, then 
strictly speaking, the system is nonlinear. In practice, we often encounter nonzero 
initial conditions and still refer to the system as being linear. 

In Example 3.2, initial rest implies that y(O) = 0, so that 

y(0) = zf-2.941 = 0, (3.10) 

and we get A = 2.941. Thus, for t > 0, the car velocity is given by 

y(t) = 2.941(e“°' 3f -e~ 2 '), t> 0. (3.11) 

What about the negative times t < 0? The condition of initial rest and the 
causality of the system imply that y(t) = 0, t <0 since x(t) = 0, t < 0 . Therefore, 
we can write the speed of the car V? e R as follows: 

y(t) = 2.941 ( e -° 3 ‘ -e- 2, )u(t). (3.12) 

This speed signal is plotted in Figure 3.3, and we can see that the car is mov- 
ing forward, as expected. 
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FIGURE 3.3 Car speed signal as the solution of a 
differential equation. 


The above remark on initial rest is true in general for causal LTI systems, as we 
now show. A linear system is causal if its output depends only on past and present 
values of x(t), but for a linear system y = Sx, the output to the zero input is zero, as 
S(0x) = 0<Sx = 0 y = 0 . Since we assumed that x( t ) = 0, t < 0 and that y (7) only de- 
pends on past or current values of the input, then we have y(t) = 0, t < 0 . 

The condition of initial rest means that the output of the causal system is zero 
until the time when the input becomes nonzero. 

CAUSAL LTI SYSTEMS DESCRIBED BY DIFFERENCE EQUATIONS 

In a causal LTI difference system, the discrete-time input and output signals are re- 
lated implicitly through a linear constant-coefficient difference equation. 

In general, an A^-order linear constant coefficient difference equation has the 
form: 

N M 

X a k y[n-k\ = Y J b k x[n-k ], (3.13) 

k = 0 k = 0 



which can be expanded to 

a N y\n — /V]-l F a l y\n — \\ + a Q y\n\ = b M x[n - M] H \-bpc\n- 1] + b 0 x[n\. (3.14) 
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The constant coefficients {« } ' and {&}“ are assumed to be real, and although 
some of them may be equal to zero, it is assumed that a N ^ 0 without loss of gen- 
erality. The order of the difference equation is defined as the longest time delay of 
the output present in the equation. To find a solution to the difference equation, we 
need more information than what the equation provides. We need N initial condi- 
tions (or auxiliary conditions) on the output variable (its N past values) to be able 
to compute a specific solution. 

General Solution 

A general solution to Equation 3.13 can be expressed as the sum of a homogeneous 

N 

solution (natural response) to X a k y\. n — k] = 0 and a particular solution (forced 

k=0 

response), in a manner analogous to the continuous-time case. 

y[n] = y h [n] + y p [n]. (3.15) 

The concept of initial rest of the LTI causal system described by the difference 
equation here means that x[n\ = 0, Vw < n implies y[«] = 0, V«<« 0 . 

Example 3.3: Consider the first-order difference equation initially at rest: 

y[n] + 0.5 y\n - 1] = (-0.8)"m[«]. (3.16) 

The solution is composed of a homogeneous response (natural response), and 
a particular solution (forced response) of the system: 

y[n\ = y h [n\ + y p [n ], (3.17) 

where the particular solution satisfies Equation 3.16 for n > 0, and the homoge- 
neous solution satisfies 


y h [n\ + ti.5y h [n-\\ = 0. (3.18) 

For the particular solution for n > 0, we look for a signal y p \n\ of the same form 
as x[n\. y p [n\ = T(-0.8)" . Then, we get 

T(-0.8)" +0.57(-0.8)" _1 = (-0.8)” 
o 

y[l + 0.5(-0.8) _1 ] = l 



(3.19) 
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which yields 


^[»] = |(-0.8) B . (3.20) 

Now let us determine [ 77 ], the natural response of the system. We hypothesize 
a solution of the form of an exponential signal: y h [n] = Az n . Substituting this ex- 
ponential in Equation 3.18, we get 

Az” +0.5 Az n ~ l =0 

<=> 

l + 0.5z _1 =0 

z = -0.5. (3.21) 

With this value forz, y h [n] = A (-0.5)" is a solution to the homogeneous equa- 
tion for any choice of A. Combining the natural response and the forced response, 
we find the solution to the difference Equation 3. 16 for n > 0: 

y[n] = y h [n] + y p [n] = A(-0.5) n + |(-0.8)". (3.22) 

The assumption of initial rest implies y[-\] = 0, but we need to use an initial 
condition at a time where the forced response exists ( for n > 0), that is, v[0], which 
can be obtained by a simple recursion. 

y[n] = -0.5y\n - 1] + (-0.8)" w[/i] 

77 = 0: y[0] = — 0.5_v[ — 1] + (-0.8)° =0 + 1 = 1 (3.23) 

Note that this remark also holds for higher-order systems. For instance, the re- 
sponse of a second-order system initially at rest satisfies the conditions y [-2] = 
y[-l] = 0, buti'[0],y[l ] must be computed recursively and used as new initial con- 
ditions in order to obtain the correct coefficients in the homogeneous response. In 
our example, the coefficient is computed as follows: 

3,[0] = 1 = ^(-0.5)° + 1(-0.8)° = -4 + 1 


(3.24) 
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Therefore, the complete solution is (check that it satisfies Equation 3.16 as an 
exercise) 

y[n\ = -|(-0.5)' , m[»] + |(-0.8)"mW. (3.25) 

Recursive Solution 

In the discrete-time case, we have an alternative to compute y\n\ : we can compute 
it recursively using Equation 3.13 rearranged so that all the terms are brought to the 
right-hand side, except y\n\. 

j ( » N ^ 

y[n\ = — X b k x[n-k]-^a k y\n-k \ . (3.26) 

a o V*=0 k = 1 J 

Suppose that the system is initially at rest and that x[«] has nonzero values 
starting at n = 0. Then, the condition of initial rest means thaty [— 1 ] =y\- 2] = • • • 
= y[-A r | = 0, and one can start computing y[n] recursively. This is often how digi- 
tal filters are implemented on a computer or a digital signal processor board. This 
is also how a simulation of the response of a differential equation is typically com- 
puted: first, the differential equation is discretized at a given sampling rate to ob- 
tain a difference equation, and then the response of the difference equation is 
computed recursively. We will talk about sampling and system discretization in 
some detail in subsequent chapters. 

Example 3.4: Consider the difference equation: 

5 1 

y\n\ — y\n — \\ + — y\n~2] = 2>x[n\-2x[n-\\. (3.27) 

6 ’ 6 ’ 

Taking the second and third terms on the left-hand side of Equation 3.27 to the 
right-hand side, we obtain the recursive form of the difference equation: 

5 1 

y\n ] = — y[n — 1] — y[n -2] + 3x[«]- 2x[n - 1]. (3.28) 

6 ' 6" 

Assuming initial rest and that the input is an impulse x[«] = 8\n\ , we have 
y[- 2] = y[— 1] = 0, and the recursion can be started: 
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ON THE CD 


j[0] = \a- 1] -\a- 2] + 3x[0] - 2x[-l] 
6 6 

= ^( 0 )-i(°) + 3 ( 1 )- 2 ( {) ) = 3 
6 6 

J[1] = 7J[0]-^[-1] + 3 41]-2x[0] 

6 6 

= ~( 3 )-~(0) + 3 (0)-2(l) = ^ 

6 6 2 

j[2] = 7j[l]-^[0] + 3 x[2]-2x[l] 

6 6 

= f4>4(3) + 3<0)-2<0) = -l 


(3.29) 


The following MATLAB program, which can be found on the CD-ROM in 
D:\Chapter 3 \recursion.m, computes and plots the response of the difference system 
in Example 3 .4 by recursion. 


%% recursion.m computes the response of a difference system recursively 
% time vector 
n=0 : 1 : 15; 

% define the input signal 
x=[1 zeros(1 ,length(n)-1) ] ; 
y=zeros(1 ,length(n) ) ; 

% initial conditions 

yn_1=0; 

yn_2=0; 

xn_1=0; 

xn=0; 

% recursion 
for k=1 :length(n) 
xn=x(k) ; 

yn=(5/6) *yn_1 - (1 /6) *yn_2+3*xn-2*xn_1 ; 

y(k)=yn; 

yn_2=yn_1 ; 

yn_1=yn; 

xn_1=xn; 

end 

% plot output 
stem(n,y) 
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Note that because this system is LTI, it is completely determined by its impulse 
response. Thus, the response to the unit impulse that we obtain here numerically by 
recursion is actually the impulse response of the system. For a simpler first-order 
system, it is often easy to find the “general term” describing the impulse response 
h[n] for any time step n. For example, you can check that the causal LTI system de- 
scribed by the difference equation, 


y\n ] + 2y[n - 1] = x\ri]. 


has an impulse response given by h[n] = (-2)" u[n \ . 



((Lecture 10: Impulse Response of a Differential System )) 


(3.30) 


IMPULSE RESPONSE OF A DIFFERENTIAL LTI SYSTEM 


Consider again the general form of a causal LTI differential system of order N: 


^ d k y(t) ^ , d k x(t) 
2.^— 7 ^ = 2A— 7 ^- 

k= 0 Ul k= 0 Wf 


(3.31) 


In this section, we give two methods to compute the impulse response of such 
a system. 

Method 1 : Impulse Response Obtained by Linear Combination of Impulse 
Responses of the Left-Hand Side of the Differential Equation 

The step-by-step procedure to find the impulse response of a differential LTI sys- 
tem is as follows: 


1 . Replace the whole right-hand side of the differential Equation 3.3 1 by 8(f). 

2. Integrate this new equation from t = 0” to t = 0 + to find a set of initial con- 
ditions at t = 0. 

3. Calculate the homogeneous response h a (t) to the homogeneous equation 
with these initial conditions. 

4. Finally, differentiate the homogeneous response h a (t) and use linear super- 
position according to the right-hand side of the differential equation to 
form the overall response of the system. 

The procedure is based on the properties of linearity and commutativity of LTI 
systems. Differential systems can be seen as the combination of two subsystems. 




102 Fundamentals of Signals and Systems 


each one defined by a side of the differential equation, as illustrated in Figure 3.4. 
The first subsystem processes the input signal by implementing the right-hand side 
of the equation, that is, by forming a linear combination of the input and its deriv- 
atives. The second subsystem implements the left-hand side of the differential 
equation, with its input being the output of the first subsystem. Both of these sub- 
systems are LTI, and therefore each one has an impulse response. Let the impulse 
response of the second one be denoted as h a (t). Another consequence of the LTI 
properties is that, by commutativity, the order of the subsystems can be inter- 
changed, as shown in Figure 3.5. 


hJO 



FIGURE 3.4 Differential system as the cascade of two LTI subsystems. 


A(0 



FIGURE 3.5 Cascade of two LTI subsystems equivalent to the differential system. 


The block diagram in Figure 3.5 suggests how the procedure works. Steps 1-3 
compute the impulse response h a (t) of the first block, and Step 4 computes the im- 
pulse response of the overall differential system by applying the second block (the 
right-hand side of the differential equation) to hjf) in order to get h(t). 


Step 1 : Under the assumption that N > M and the system is initially at rest, 
that is, 


y( 0 ") 


dy( 0 ) 
dt 


d N ~ l y(0~) 

dt N ~ l 


= 0 , 
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we first replace the right-hand side of Equation 3.3 1 with a single unit impulse: 


IX 


d k h a (t) 

dt k 


= < 5 ( 0 - 


(3.32) 


Step 2 : To solve this equation for h a (t), we first observe that the impulse can 
only be generated by the highest-order derivative (i.e., k - N) of hjt). Other- 
wise, we would have derivatives of the impulse function in the right-hand side 

of Equation 3.5. This means that the functions hjt), - d X are 
smooth or have finite discontinuities at worst. Such functions integrated over 
an infinitesimally small interval simply vanish. This important observation 
(make sure you understand it!) gives us the first N- 1 initial conditions for h a (t) 
when we integrate those functions from t = 0" to t = 0 + : 


1 


dt k 


dx = 


dt k ~ x 


k = 1, 


N- 1. 


(3.33) 


Then, integrating both sides of Equation 3.32 from t- 0 to t = 0 + , we obtain 
" ° : d k h(x) °r d N h (x) d N ~\{ 0 + ) 


V r u n \'L I , r 

X a ,j^p^ dT = a sj 


k = 0 


d h (T) d * .. v . 7 

~^dx = a N ' =1, (3.34) 


df 


df 


which gives us our N th initial condition at t = 0 + : 


d N ~\{ 0 + ) = 1 

dt a. 


(3.35) 


Step 3: Thus, starting at time t = 0 + , we need to solve the homogeneous 

equation, 


IX 


dt k 


= 0 , 


(3.36) 


subject to the above initial conditions. Assume that the solution has the form of 
a complex exponential Ae' 1 for t > 0, where A, s e C . Substituting this expo- 
nential into Equation 3.36, we get a polynomial in 5 multiplying an exponen- 
tial on the left-hand side: 

Ae s, '^_ i a k s k = 0 . 

k = 0 


(3.37) 
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With the assumption that A T 0, this equation holds if and only if the charac- 

N 

teristic polynomial p(s ) := ^ a.s vanishes at the complex number 5 : 

k = 0 
N 

p(s) = Y, a/ = a N s N + a N _ x s N ~ l + ■ ■ ■ + a Q = 0. (3.38) 

k = 0 

By the fundamental theorem of algebra. Equation 3.38 has at most A distinct 
complex roots. Assume for simplicity that the A roots are distinct, and let them be 
denoted as j.y ( }' . This means that there are A distinct functions A k e k ' that satisfy 
the homogeneous Equation 3.36. Then, the solution to Equation 3.36 can be writ- 
ten as a linear combination of these complex exponentials: 

N 

h a( t ) = Y l A / kt - (3.39) 

k = 1 


The A complex coefficients { A k can be computed using the initial conditions: 


o=*.(o*)=£v 


1 4 


dh ( 0 + ) 
0 = — — — - 
dt 



1 


a 


N 


d N ~\{ 0 + ) 

dt N ~ l 




This set of linear equations can be written as follows: 


0 


" 1 

1 • 

• 1 


0 





A 2 

0 

— 

s i 2 

2 

5 2 ' 

2 

' S N 

A S 

yi a N _ 



s N . 
A 2 

■ s N 

J 

A n 


(3.40) 


(3.41) 


The A X A matrix with complex entries in this equation is called a Vander- 
monde matrix and it can be shown to be nonsingular (invertible). Thus, a unique 
solution always exists for the A^’s, which gives us the unique solution hjt) through 
Equation 3.39. 
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Step 4: Finally, the impulse response of the general causal LTI system described 
by Equation 3.3 1 is a linear combination of hJJ) and its derivatives as shown in 
the second block of Figure 3.4. Hence, the impulse response is given by 


M 

h(t)=Yj b k 


k = o 


d k h a (t) 

dt k 


(3.42) 


Example 3.5: Consider the first-order system initially at rest with time constant 

T 0 >0: 

dy(t) . d . . 

T 0 ^— + y(t) = —x(t) + x(t). (3.43) 

dt dt 

Step 1 : Set up the first problem of calculating the impulse response of the left- 
hand side of the differential equation. 

dh ( t ) 

T °dt +h " (t) = 5{t) (3 ‘ 44) 

Step 2 : Find the initial condition of the homogeneous equation at t = 0 + by 
integrating on both sides of Equation 3.2 from t = 0" to t = 0 + . Note that the im- 
pulse is produced by the term T 0 , so h a (t) will have a finite jump at most. 
Thus we have 


r dh (t) ° r 

J^ 0 — jr-dT+ jh a (T)dT = z 0 h a (0 ) = 1, (3.45) 

o~ <r 

=o 

and hence h ( 0 + ) = — is our initial condition for the homogeneous equation: 

dh (, t ) 

*°-J— •-*( 0 = °- (3.46) 

Step 3 : The characteristic polynomial is p(s) = f 0 s + 1 and it has one 
zero at s = -T 0 - 1 which means that the homogeneous response has the form 

h a (t) = Ae T ° for t > 0. The initial condition allows us to determine the con- 
stant A: 


h a (0 + ) = A = -, 

T„ 


(3.47) 
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so that 

1 ~ 

h (t) = —e °u(t). (3.48) 

T o 

Step 4: Finally, the impulse response of the differential system of Equation 
3.43 is computed by applying the right-hand side of Equation 3.43 to h a (t) as 
follows: 


dh ( t ) 


d_ 

dt 


( 


1 


A 


— e °u(t ) 
v T ° 


-I e T °u(t ) 


= -e e z °5{t)-\ e r °u(t ) 


V T o T o J 


e T|> u(t ) 4 5(t). 

T„ 


(3.49) 


Notice how the chain rule and the sampling property of the impulse are applied 

t 

in differentiating h a ( t) = r ' e r » u(t), which gives rise to the impulse in the bottom 
equality of Equation 3.49. The impulse response is shown in Figure 3.6. 



FIGURE 3.6 Impulse response of 
a first-order system. 


Method 2: Impulse Response Obtained by Differentiation of the Step Response 

We have seen that the impulse response of an LTI system is the derivative of its 
step response, that is, h(t) = - Thus, we can obtain the impulse response of 
an LTI differential system by first calculating its step response and then 
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differentiating it. This method is useful when the right-hand side of the differential 
equation does not have derivatives of the input signal. 

Example 3.6: We will illustrate this technique with an example of a second- 

order system. Consider the following causal LTI differential system initially at 
rest: 


d 2 y(t) | 3 dy(t) 
dt 2 dt 


+ 2 y(t) = x(t). 


(3.50) 


Let x(t) = u(t). The characteristic polynomial of this system is 

p(s) = s 2 + 3s + 2 = (s + 2)(s + 1), (3.51) 

and its zeros (values of s for which p(s) = 0) are s = — 2 and s = — 1. Hence, the 
homogeneous solution has the form 

y h (t) = A 1 e- 2 ' + A 2 e- t . (3.52) 

We look for a particular solution of the form y (t) = K for t > 0 when x(t) = 1 . 
Substituting in Equation 3.50, we find 

y p ( 0 = ^- (3.53) 


By adding the homogeneous and particular solutions, we obtain the overall step 
response for t > 0: 


s(t) = A { e 21 


+ A 2 e 



(3.54) 


The initial conditions at t = 0“ are " Vl ; ‘ l 1 = 0, y(0“ ) = 0 . Because the input sig- 
nal has a finite jump at t = 0 + , it will be included in d only, and , y(t) will 
be continuous. Hence, _ M ) _ q 5 and we have 

dt dt 


j(0 + ) = A l + A 2 + — = 0 


dy( 0 + ) 


= -2 A i -A 2 = 0. 


dt 


(3.55) 
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{ , A 2 = -1, which 
(3.56) 



FIGURE 3.7 Step response of the 
second-order system. 


The solution to these two linear algebraic equations is A { = 
means that the step response of the system is 


\ 1 h 

1 -it -t . 1 

— e -e + — 

V 2 2 y 


s(t) = 

This step response is shown in Figure 3.7. 


u(t). 


Finally, the impulse response of the second-order system is obtained by differ- 
entiating its step response. It is interesting to look around the origin to see whether 
or not there is a jump in the derivative of the step response. The derivative is obvi- 
ously 0 for t < 0. For t> 0, 


h(t) = 




(3.57) 


which evaluates to 0 at time t = 0 + . Hence there is no jump, and the impulse re- 
sponse, shown in Figure 3.8 is given by (check that it solves Equation 3.50) 

h{t) = [e~ l -e~ 2t ^ju(t). (3.58) 


Of course, we can directly differentiate the step response as given in Equation 
3.56 using the chain rule and the sampling property of the impulse, which yields 
the same impulse response shown in Figure 3.8: 



— e 


')u(t) 


+ 


f 1 1 5 

-e 2 ‘ -e ' +- 


v 


< 5(0 


St=0 




(3.59) 
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FIGURE 3.8 Impulse response obtained 
by differentiating the step response. 



((Lecture 11: Impulse Response of a Difference System ; Characteristic Polynomial 
and Stability)) 


IMPULSE RESPONSE OF A DIFFERENCE LTI SYSTEM 


Consider the general form of a causal LTI difference system: 

N M 

^ J a k y[n-k\ = ^ j b k x[n-k]. (3.60) 

A— 0 k = 0 

We briefly discuss one method to obtain the impulse response of this general 
causal LTI difference system initially at rest. It is similar to Method 1 for a contin- 
uous-time differential system, but it is simpler, as there is no integration involved. 

Impulse Response Obtained by Linear Combination of Shifted Impulse Responses 
of the Left-Hand Side of the Difference Equation 

The step-by-step procedure to find the impulse response of a difference LTI system 
is as follows. 

1 . Replace the whole right-hand side of the difference Equation 3.60 by S\ri\. 

2. Find initial conditions on y[«] at times n = 0,- 1 ,. . N + 1 for a homoge- 
neous response starting at time n = 1. 

3. Calculate the homogeneous response h a [n] to the homogeneous equation 
with these initial conditions. 

4. Finally, calculate h[n] as a linear combination of the current and delayed 
versions of h a [n] according to the right-hand side of the difference Equa- 
tion 3.60. 
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Step 1: Under the assumption that the system is initially at rest, that is, 

y[-l\ = y[-2] =■■■= >>[- A] = 0 , let h a [n] = y[n] and replace the right-hand 
side of Equation 3.60 with a single unit impulse: 

N 

X a k h a [rt-k] = S[n \ . (3.61) 

k = 0 


Step 2: To solve this equation for h a [n\, we first observe that, by causality, 

the impulse can only be part of h a [n], not its delayed versions h a [n - k\,k ± 0. 
This immediately gives us h a [0] = -J- . Causality and the initial rest condition 
yield the remaining initial conditions” h a [-1] = h a [-2] = • ■ •= h [- A + 1] = 0 . 
Step 3: Thus, starting at time n = 1, we need to solve the homogeneous equa- 

tion for n > 0: 


N 

'£ i a k h a [n- k ] = 0, 


k = 0 


(3.62) 


subject to the A initial conditions obtained in Step 2. Assume that the solution 
has the form of a complex exponential Cz" for n> 0. Substituting this exponen- 
tial into Equation 3.62, we get a polynomial in z~\ multiplying an exponential 
on the left-hand side. Dividing both sides by Cz" and multiplying both sides by 
z N , we get an equivalent equation: 

Cz"'^ i a k z~ k = 0 <=> ^ a k z N ~ k = 0, (3.63) 

k = 0 k = 0 

and this equation holds if and only if the characteristic polynomial p(z ) := 

N 

jr a k z N ~ k vanishes at the complex number z; that is, 

k=0 

N 

p(z ) = '^ j a k z N ~ k = a Q z N + H F a N = 0. (3.64) 

k = o 

By the fundamental theorem of algebra, this equation has at most N distinct 
roots. Assume that the N roots are distinct for simplicity and let them be denoted 
as {z t } This means that there are A distinct exponential signals C k z k " that sat- 
isfy the homogeneous Equation 3.62. Then the solution to Equation 3.62 can be 
written as a linear combination of these complex exponentials: 

W = i, C k z k- 

k=l 


(3.65) 



Differential and Difference LTI Systems 111 


The complex coefficients i can be computed using the initial conditions: 


- L = 4.[0] = tc i 


«=V-1]=S C A 


o=*.HV+i]=£c,z, 


This set of linear equations can be written as 


1 

r 

a o 


0 


0 


_ 0 _ 

- 


1 -N 1 -N 

Z, Z„ 


C. 

C 2 

c. 


c. 


(3.66) 


(3.67) 


The Vandermonde matrix on the right-hand side of Equation 3.67 can be 
shown to be nonsingular. Hence, a unique solution always exists for the Qs, which 
gives us the unique solution h a [n] through Equation 3.65. 


Step 4: Finally, by the LTI properties of the difference system, the response 

of the left-hand side of Equation 3.60 to its right-hand side is a linear combi- 
nation of h a [n ] and delayed versions of it. Therefore, the impulse response of 
the general causal LTI system described by the difference Equation 3.60 is 
given by 


M 

h[n\ = Yj b kK\.n- k\ 


k = 0 


(3.68) 


Example 3.7: Consider the following second-order, causal LTI difference sys- 

tem initially at rest: 


y\n\ - 0.5 y[n - 1] + 0.06 y[n - 2] = x[n - 1], (3.69) 


The characteristic polynomial is given by 
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p(z ) = z 2 - 0.5 z + 0.06 = (z - 0.2)(z - 0.3), (3.70) 

and its zeros are z x = 0.2, z 2 = 0.3. The homogeneous response is given by 

h a [n] = 40.2)" + 5(0.3)”, n> 0. (3.71) 

The initial conditions for the homogeneous equation for n > 0 are /? [— 1] = 0 
and h a [0] = 5[0] = 1. Now, we can compute the coefficients A and B\ 

h [-1] = A(0.2)~ l + 5(0.3) _1 = 5H + — 5 = 0, (3.72) 

a ^ 

h a [Q\ = A + B = \. (3.73) 


Hence, A = -2,5 = 3, and the impulse response is obtained by performing 
Step 4: 


h[n\ = h a [n-\\ = 


-2(0.2)" _1 + 3(0.3)" _1 


u[n — 1]. 


(3.74) 


CHARACTERISTIC POLYNOMIALS AND STABILITY OF 
DIFFERENTIAL AND DIFFERENCE SYSTEMS 


The BIBO stability of differential and difference systems can be determined by an- 
alyzing their characteristic polynomials. 

The Characteristic Polynomial of an LTI Differential System 

Recall that the characteristic polynomial of a causal differential LTI system of the 
type 


^ d k y(t) ^ , d k x{t) 

L a *—^ = l A-rr- 


is given by 


p(s) := a N s N + a N _ { s N ~' +■■■ + %. 


(3.75) 


(3.76) 


This polynomial depends only on the coefficients on the left-hand side of the 
differential equation. It characterizes the intrinsic properties of the differential sys- 
tem, as it does not depend on the input. The zeros of the characteristic polynomial 
[s k are the exponents of the exponentials forming the homogeneous response, so 

they give us an indication of the system properties, such as stability. 




Differential and Difference LTI Systems 113 


Stability of an LTI Differential System 

We have seen that an LTI system is BIBO stable if and only if its impulse response 
is absolutely integrable, that is, J |/?(/)|c/t < . We have also figured out that a 

general formula for the impulse response of the system described by Equation 3.3 1 
is given by 


M N 

k=0 dt 


V nt=\ , 


K(t) 


(3.77) 


where the zeros | of the characteristic polynomial are assumed to be distinct. 
Now we have to be concerned with the possibility of derivatives of impulses at 
time t = 0 in h(t). Recall that the first N - 1 derivatives of h a (t) are either smooth 
functions or may have a finite jump (for k = N - 1), while the impulse appears in 
“J . Thus, under the assumption that N > M. the impulse response h(t) will have 
at worst a single impulse at t = 0, which integrates to a finite value when integrated 
from t = -oo to t = 0 + . Under these conditions, the stability of the system is entirely 
determined by the exponentials in Equation 3.77. To show this, let us find an upper 

+oo ■ 

bound on J |/?(Y)|ifr: 


\\m\dt=\ 


M 


d k( N 


ut y rn = 1 J 


UIKI 

0+ k - 0 
M 00 

-XWJ 


k=0 

M 


dt k 

d k 


= 11**11 


k = 0 
M 


dt 

N 

X4 

m = 1 
N 


( N 


\ 

I 

A e ' ■ 

m 

t 

\m= 1 


) 

( N 



s 

A e ■ 

m 

t 

y m= 1 


/ 


dt 


\dt 


dt 


k st 

. s e m 

m m 


A k st 

A s e m 

m m 


sXKIJZl 

k = 0 0+ m= 1 

M N 00 

s SI*.|IlW|J 


dt 


\dt 


R e {,s OT }f 


dt. 


(3.78) 


We can see from the last upper bound in Equation 3.78 that the integral of the 
magnitude of the impulse response is infinite only if J e Re{s " }l dt is infinite for 



114 Fundamentals of Signals and Systems 


some m g M } . This occurs only if Rc{.v m } > 0 . It can be shown that this nec- 
essary condition of stability is also sufficient modulo the next remark. That is, if at 
least one of the zeros of the characteristic polynomial has a nonnegative real part, 
then the system is unstable. 

With the earlier assumptions that the zeros of the characteristic polynomial are 
distinct and that N > M , a causal LTI differential system is BIBO stable if and 
only if the real part of all of the zeros of its characteristic polynomial are negative 
(we say that they lie in the left half of the complex plane). 

Remark: The purist might say that the causal differential system described by 

^-y(t) = ^-x(t)-x(t) (3.79) 

at at 

is BIBO stable, even though the zero s = 1 of its characteristic polynomial lies in 
the right half of the complex plane. Indeed, if one computed the impulse response 
of this system by using the procedure outlined above, one would get the identity 
system h(t) = S(t), whose impulse response is absolutely integrable. Thus, strictly 
speaking, the system of Equation 3.79 is BIBO stable, but as engineers, we must be 
aware that even if the input signal is identically zero for all times, any nonzero ini- 
tial condition on the output signal, even infinitesimal, or any perturbation of the co- 
efficients will excite the unstable exponential e' in the homogeneous response and 
will drive the output to infinity. Therefore, this type of system must be considered 
unstable. We will describe such systems in subsequent chapters as having a pole 
canceling a zero in the closed right half of the complex plane. A physical system 
described by such a differential equation will surely be unstable in practice. 

Example 3.8: Let us assess the stability of the causal LTI differential system de- 

fined as 


^--2y(t) = x(t). (3.80) 

at 

The characteristic polynomial is p(s) = s — 2, which has its zero at s = 2. This 
system is therefore BIBO unstable, which is easy to see with an impulse response 
of the form Ae 2, u(t), a growing exponential. 

The Characteristic Polynomial of an LTI Difference System 

Recall that the characteristic polynomial of a causal difference LTI system of the 
type 
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N M 

X a k v[n -k] = Yj b k x[n-k] 


k = 0 


k = 0 


is given by 

N 

p(z ) = ^a k z N ~ k = a 0 z N + a { z N ~ l H \- a N =0. 

k = o 


(3.81) 


(3.82) 


This polynomial depends only on the coefficients on the left-hand side of the dif- 
ference equation. The zeros {z t }^ (assumed to be distinct) of the characteristic 
polynomial are the arguments of the exponentials forming the homogeneous re- 
sponse, so they also give us an indication of system properties, such as stability. 


Stability of an LTI Difference System 

Recall that a discrete-time LTI system is stable if and only if its impulse response 

+oo 

is absolutely summable, that is, X M w ] < +°° . For the causal difference system 
above, this leads to the following upper bound: 


X /; l"l =x 


n = 0 


k = 0 
M 

n = 0 k = 0 
M Too 


k=0 n=k 
M Too 

=sih 

£=0 n=k 

M +oo 

^XXKEI c Jk 

k = 0 n=k m = 1 
M N Too 


I C. 

m = 1 
N 


n-k 


=y h. y c t z r* 

\ k \ \ m \ X-^ 1 m | 

k= 0 m= 1 n=k 


M N Too 

=XkE c JE z J’ 

(3.83) 


k = 0 m = 1 


and this last upper bound is finite if and only if |zj < 1, for all m = l,...,N . Hence, 
the causal LTI difference system is BIBO stable only if all the zeros of its charac- 
teristic polynomial have a magnitude less than 1. This necessary condition for 
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stability turns out to be sufficient as well, and hence BIBO stability is equivalent 
to having all the zeros have a magnitude less than 1. Note that the previous 
remark also applies to discrete-time difference systems: a system of the type 
y[n]+2y[n - 1] = x\n]+2x[n - 1] must be considered unstable even though its im- 
pulse response h[n] = 8[n] is absolutely summable. Round-off errors in a digital 
implementation of such a difference system would destabilize it. 

Example 3.9: Consider the causal first-order LTI difference system: 

y\n\ — 0.9y\n — 1] = x\n\. (3.84) 

Its characteristic polynomial is p(z) = z- 0.9, which has a single zero at 
Zj = 0.9. Hence, this system is stable, as |z 1 | = 0.9<l. Its impulse response is 
shown in Figure 3.9. 



FIGURE 3.9 Impulse response of the 
first-order system. 


TIME CONSTANT AND NATURAL FREQUENCY OF 
A FIRST-ORDER LTI DIFFERENTIAL SYSTEM 


In general, the impulse response of an LTI differential system is a linear combina- 
tion of complex exponentials of the type Ae'u(t ) and their derivatives. Consider 
the stable, causal first-order LTI differential system: 

dv(t) 

+ a 0 y(t) = Kx(t). (3.85) 

Its impulse response is a single exponential, hit ) = Ae'‘u(t), where ^ = - — 
K II 

and A - — . The real number CQ n := p 1 , is called the natural frequency of the 
first-order system, and its inverse T„ := — = is called the time constant of the 

J u CO n a Q 
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first-order system. The time constant indicates the decay rate of the impulse re- 
sponse and the rise time of the step response. At time t = x 0 , the impulse response 

is h(z Q ) = Ae T ° = Ae~ l = 0.37 A, so the impulse response has decayed to 37% of its 
initial value, as shown in Figure 3.10. The step response is also shown in this fig- 
ure, and it can be seen that it has risen to 63% of its settling value after one time 
constant. 


h(t) - Ae r ” u(t) 




FIGURE 3.10 Impulse response and step response of the first-order system. 


EIGENFUNCTIONS OF LTI DIFFERENCE AND 
DIFFERENTIAL SYSTEMS 


We have used the fact that complex exponential signals of the type Cz" and Ae' 1 re- 
main basically invariant under the action of time shifts and derivatives, respec- 
tively, to find the homogeneous responses of LTI difference and differential 
systems. 

The response of an LTI system to a complex exponential input is the same 
complex exponential, with only a change in (complex) amplitude. 

Continuous-time LTI system: e sl * h(t) = H(s)e s> (3.86) 

Discrete-time LTI system: z" * h[n\ = H(z)z" (3.87) 

The complex amplitude factors H(s) and H(z) are in general functions of the 
complex variables 5 and z. 

Input signals like x\n] = z" and x(t) = e st for which the system output is a 
complex constant times the input signal are called eigenfunctions of the LTI sys- 
tem, and the complex gains are the system’s eigenvalues corresponding to the 
eigenfunctions. To show that e' 1 is indeed an eigenfunction of any LTI system of 
impulse response h(t), we look at the following convolution integral: 




118 Fundamentals of Signals and Systems 


+oo +oo 

y(t)= J h(z)x(t - z)dz = J h(z)e sU ~ T) dz 

+oo 

= e s ' J h{z)e~ sx dz 


(3.88) 


The system’s response has the form y(t) = H(s)e sl , where //(.v) := J h(z)e~ ST dz, 
assuming the integral converges. For LTI discrete-time systems, the "complex ex- 
ponential z' 1 is an eigenfunction: 

+oo Too 

y[n] - ^ h[k]x[n -k]= ^ h[k]z n ~ k 

k =- oo k =- oo 

Too 

= /z[&]z~* (3.89) 

k=-°o 

+°° _ , 

The system’s response has the form y[«] = H(z)z", where H{z)= Y. h[k]z , 

k=- 

assuming that the sum converges. The functions H(s) and H(z) are, respectively, the 
Laplace transform and the z-transform of the system’s impulse response. Each is 
called the transfer function of the system; more on this in Chapter 6 and Chapter 13. 


SUMMARY 


In this chapter, we introduced special classes of LTI systems: differential and dif- 
ference systems. 

■ The classical solution composed of the sum of the forced response and the nat- 
ural response was reviewed for both differential and difference systems. 

■ Since an LTI system is completely characterized by its impulse response, we 
gave step-by-step techniques to compute the impulse responses of differential 
and difference systems. 

■ The BIBO stability of differential and difference systems was analyzed with 
respect to the characteristic polynomial. 

■ The time constant of a first-order differential system and its corresponding 
natural frequency were introduced. 

■ Finally, it was pointed out that exponential signals are basically invariant (only 
their complex amplitude varies) when processed by a differential or difference 
system. 
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TO PROBE FURTHER 


The classical subject of linear constant-coefficient ordinary differential equations 
can be found in many basic mathematics textbooks, for example, Boyce and 
Diprima, 2004. An advanced treatment of difference equations can be found in 
Kelley and Peterson, 200 1 . 


EXERCISES 

Exercises with Solutions 

Exercise 3.1 

Consider the following first-order, causal LTI differential system 5! initially at rest: 

d\ ( t ) + ^ _ dx(t) _ 2 X ^ a > o is real. 

1 dt ' y, dt W 

(a) Calculate the impulse response h x (t) of the system <Sj. Sketch it for a = 2. 


Answer: 

Step 1 : Set up the problem to calculate the impulse response of the left-hand 

side of the equation: 


dhjA) 

dt 


+ ah a (t ) = S(t). 


(3.59) 


Step 2: Find the initial condition of the corresponding homogeneous equa- 

tion at t = 0 + by integrating the above differential equation from t = 0“ to t = 0 + . 

Note that the impulse will be in the term — , so hjt) will have a finite jump 

0 + 

at most. Thus, we have [ dh 2 r> dr = k(0 + ) = 1, and hence /? (0 + ) = l is our 

J dl ^ 

0 " 

initial condition for the homogeneous equation for t > 0: 


dh a (t) 


+ ah a (t ) = 0. 


dt 
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Step 3: The characteristic polynomial is p(s ) = .v + a , and it has one zero at 

s = -a , which means that the homogeneous response has the form 
h (t) = Ae~ a ‘ for t> 0. The initial condition allows us to determine the constant 
A: h a { 0 + ) = A = 1, so that 


h a (t) = e at u(t). 


Step 4: LTI systems are commutative, so we can apply the right-hand side of the 

differential equation to h a (t) in order to obtain h\{t)\ 


dh ( t ) 

= ^-^e~ a, u{t)j - 2 e~ a, u(t) 
= -(2 + a)e~ a 'u(t) + 8(t) 


This impulse response is plotted in Figure 3.11 for a = 2. 
(b) Is the system 5, BIBO stable? Justify your answer. 



FIGURE 3.1 1 Impulse response of the first-order 
differential system. 


Answer: 

Yes, it is stable. The single real zero of its characteristic polynomial is negative: 
s = -a< 0. 
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Exercise 3.2 

Consider the following second-order, causal LTI differential system S 2 initially at 
rest: 


d 2 y(t) dy(t ) ^ . . . . 

/w - + 5 + 6 y(t) = x(t). 


dt 1 


dt 


Calculate the impulse response of the system S 2 . 


Answer: 
Solution 1: 


Step 1: Set up the problem to calculate the impulse response of the system: 


d 2 h^(t) dh 2 (t ) 

dt 2 dt 


+ 6 h^(t) = 8(t ) 


Step 2: Find the initial conditions of the corresponding homogeneous equa- 

tion at t = 0 by integrating the above differential equation from t = 0“ to t = 0 + . 

Note that the impulse will be in the term —^r~, so dh 2 {t) will have a finite jump 
at most. Thus we have 

°f d 2 h 2 {x) d z _ dh 2 (Q + ) _ \ 
j dr 2 dt 

Hence, dh: ^ ) = 1 is one of our two initial conditions for the homogeneous 
equation for t > 0: 


dt 2 


+ 5 


dh , (t) 
dt 


+ 6 h 2 (t) = 0. 


Since 


hJ 0 + ) = 0. 


dh 2 (t) 

dt 


has a finite jump from t = 0 to t ~ 0 + , the other initial condition is 


Step 3: The characteristic polynomial is p(s) = s 2 + 5s + 6 and it has zeros at 

.S' = -2, ,s, = -3 , which means that the homogeneous response has the form 

2 1 2 / 

h 2 (t) = Ae~" + Be~* for t > 0. The initial conditions allow us to determine 
constants A and B: 
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h 2 (0 + ) = 0=A+B, 


dh 2 ( 0 + ) 
dt 


\ = -2A-3B, 


so that A = 1, B = -1 , and finally, 

/z, (t) = ^ e~ 2t - e~ 3 ‘^u(t). 

Solution 2 (step response approach): 


Step 1: Set up the problem to calculate the step response of the system: 


d 2 h 2 (t) 

dt 2 


+ 5 


dh 7 (t) 
dt 


+ 6 h 2 (t) = u(t). 


Step 2: Compute the step response as the sum of a forced response and a ho- 

mogeneous response. 

The characteristic polynomial of this system is 

p(s) = s 2 + 5s + 6 = (s + 2)(s + 3). 

Hence, the homogeneous solution has the form 

y h (t)=Ae~ 2 ' +Be^'. 

We look for a particular solution of the form y ( t ) = K for f > 0 when x( t ) = 1. 
We find 


y,M)= 


]_ 

6 ' 


Adding the homogeneous and particular solutions, we obtain the overall step 
response for t > 0 : 


s( t) = Ae 21 + Be 31 



The initial conditions at t 

s{ 0 ) — 0 — A + B H — 5 
v 7 6 


0~ are s(0 ) = 0, — (0 ) = 0 . Thus, 

dt 
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which means that the step response of the system is 


s(t) = 


\ 1 1 h 

1 -2t , 1 - 3 1 . 1 

— e +—e +— 


V 


u(t). 


2 3 6 , 

Step 3: Differentiating, we obtain the impulse response, 


h(t) = ~J~ S (0 = [e 2> ~e 3, 'ju(t). 


Exercise 3.3 

Consider the following second-order, causal LTI differential system S initially at 
rest: 


d 2 y(t) dy(t) 
dt 2 dt 


+y(t)=x(t). 


(a) Compute the response y(t) of the system to the input x(t) = 2u(t) using the 
basic approach of the sum of the forced response and the natural response. 


Answer: 

First we seek to find a forced response of the same form as the input: y (t) = A . 
This yields A = 2. Then, the natural response of the homogeneous equation 


d 2 y h (t) | dy h (t) 
dt 2 dt 


+y h { 0 = 0 


will be a linear combination of terms of the form e st . Substituting, we get the char- 
acteristic equation with complex roots: 


s ! +s + l = (s+i-;^ X i + i + y^) = 0. 


Thus, the natural response is given by 




y h ( 0 = A e 


2 +A 2 e 2 


i . 

2 


The response of the system is the sum of the forced response and the natural 
response: 
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y(t) = y h (t)+y p (t) = \e 2 1 2 ) + A 1 e 2 7 2 ’ + 2. 

The initial conditions (zero) allow us to compute the remaining two unknown 
coefficients: 

y(0 + ) = A l + A 2 +2 = 0 

We find A x = -1 - j A 2 = -1 + j , which are complex conjugates of 
each other, as expected. Finally the response of the system is the signal 


' 1 ,_I_ 1 ( _I + ■'ll v ^ 

y(t) = y M (*)+y p (t)= (-W^)e 272 +(- 1+ y^> 2 7 2 + 2 «(0 

= 2Rej (-1+ /-^=)e 2 U 2 +2 w(f) 


-1/ Vs 1 Vs I 

= 2e 2 -cos — t ;=sin — t u(t) + 2u(t) 

2 VI 2 


(b) Calculate the impulse response /i(?) of the system. 


Answer: 

Step 1 : Set up the problem to calculate the impulse response of the left-hand 
side of the equation. Note that this will directly give us the impulse response 
of the system: 


d 2 h(t ) dh(t) 
dt 2 dt 


+ h(t) = <5(0- 


Step 2 : Find the initial conditions of the corresponding homogeneous equation 
at t = 0 + by integrating the above differential equation from t = 0 to t = 0 + . Note 
that the impulse will be in the term d ^p-, so VV w '^ have a finite jump at 
most. Thus we have 


r d 2 h(T) dh(0 + ) _ 

1 dz 2 dt 
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Hence, dh ^ 1 = 1 is one of the two initial conditions for the homogeneous 


equation for t > 0: 


d h{t) dh{t) 


+ ^^ + h(t) = 0 . 


dt dt 


Since dh ^ ' has a finite jump from t = 0 to t = 0 + , the other initial condition is 
h( 0 + ) = 0. 

Step 3 : From ( a), the natural response is given by 


h(t) = A.e 2 2 +A,e 2 2 , 


t> 0. 


■r ■ 2 

The initial conditions allow us to determine the constants: 


dh( 0 + ) 
dt 


h{0 + ) = 0 = A x + A 2 , 


so that A 1 = ^ ,A 2 = - , and finally, 


h(t) = 


( . 1 ,V3 . 1 .73 ^ 


u(t ) 


= 2Re 
2 


( ■ .S' 

J- i ] T' 


e 2 u(t) 


V3 


sm 




f rz \ i 

-t 


v 2 , 


e 2 u(t) 


Exercise 3.4 

Consider the following second-order, causal difference LTI system S initially at 
rest: 


S: y\n\-0.6Ay\n- 2] = x[n] + x[n - 1]. 


Compute the response of the system to the input x[n] = (0.2 )"«[«] . 
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Answer: 

The characteristic polynomial is z 2 -0.64 = (z-0.8)(z + 0.8) , with zeros 
Zj = -0.8, z 2 = 0.8 . The homogeneous response is given by 

h a [n] = A(-0.8)" + 5(0.8)", n> 0. 

The forced response for n > 1 has the form y [«] = C( 0.2)" : 

C(0.2)" - 0.64C(0.2)"~ 2 = (0.2)" + (0.2)"" 1 
C(l-0.64(0.2)“ 2 ) = 1 + (0.2) _1 

C = — = -0.4. 

-15 

Notice here that we assume that n > 1 so that all the terms on the right-hand 
side of the difference equation are present in the computation of the coefficient C. 
The assumption of initial rest implies y\- 2] = y[- 1] = 0 , but we need to use initial 
conditions at times when the forced response exists (for n > 1), that is, y[ 1], y[ 2], 
which can be obtained by a simple recursion: 

y[n\ = 0.64 y[n - 2] + (0.2 )"u[n] + (0 .2)"“'m[« - 1] 

„ = 0: y[ 0] = 0.64(0) + ( 0.2)° +0 = 1 
n = 1 ; y[l] = 0.64(0) + (0.2) 1 + (0.2)° = 1 .2 
n = 2: y[ 2] = 0.64(1) + (0.2) 2 + (0.2) 1 = 0.88. 

Now, we can compute the coefficients A and B\ 

y[ 1] = ri(-0.8)' + 5(0.8)' - 0.4(0.2)' = 1 .2 
=» -0.85 + 0.85 = 1.28 
y[ 2] = A(-0.8) 2 + 5(0. 8) 2 - 0.4(0.2) 2 = 0.88 
=^> 0.645 + 0.645 = 0.896 

This yields 5 = -0. 1, 5 = 1.5. Finally, the overall response is 
y[n ] = [-0.1(-0.8)" + 1. 5(0.8)" -0.4(0.2)" ]«[«]. 
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Exercise 3.5 

Consider the causal LTI system initially at rest and described by the difference 
equation 


y\n ] + 0.4y[« - 1] = x[«] + x[n - 1], 

Find the response of this system to the input depicted in Figure 3.12 by 
convolution. 


2 » 

... JT 

3 ( 

i 

i 

A 

1 

n 

i 

» 2 

-3 -2 -1 

0 12 3 4 fl 


FIGURE 3.12 Input signal of the difference 
system. 


Answer: 

First we need to find the impulse response of the difference system. The character- 
istic polynomial is given by 


p(z) = z + 0.4, 

and its zero is z = -0.4 . The homogeneous response is given by 

h a \n\ = A(-0.4) n , n> 0. 

The initial condition for the homogeneous equation for n > 0 is h a [ 0] = <S[0] = 1. 
Now, we can compute the coefficient A: 

h a m = A = 1. 

Hence, h [n\ = (-0.4)" u[n\ , and the impulse response is obtained as follows: 

h[n] = h a [n\ + h a [n - 1] = (-0.4)"w[rc] + (-0.4)" _1 m[« - 1]. 

Secondly, we compute the convolution y\n\ = h[n]*x[n] . Perhaps the easiest 
way to compute it is to write 



128 Fundamentals of Signals and Systems 


y\ri\ = ^ x[k]h[n - k] 

k=-o - 

= x[-2 ]h[n + 2] + x[-l ]h[n + 1] + x[0]A[«] + x[\~\h[n - 1] + x[2\h[n - 2] + x[3 ]h[n - 3] 

= h[n + 2] + 2 h[n + 1] + 3 h[n] + 2h[n - 1] + 2 h[n — 2] + 2 h[n - 3] 

= (-0.4)" +2 u[n + 2] + (-0.4)" +1 u[n + 1] + 2(-0.4)" +1 u[n + 1] + 2(-0.4)" u[n\ + 3( -0.4)" u[n] 
+3( -0.4)"” 1 u[n - 1] + 2( ■ -0.4)- 1 u[n - 1] + 2(-0.4)"‘ 2 u[n - 2] + 2(-0.4)"- 2 u[n - 2] 
+2(-0.4)"- 3 m[« - 3] + 2(-0.4)"‘ 3 u[n - 3] + 2(-0.4)"- 4 m[« - 4] 

= (-0.4)' ,+2 w[« + 2] + 3(-0.4)" +1 u[n + 1] + 5(-0.4)" u[n] + 5(-0.4)"-‘ u[n - 1] 
+4(-0.4)"“ 2 m[« - 2] + 4(-0.4)"‘ 3 m[« - 3] + 2(-0.4)"- 4 «[« - 4]. 


Exercises 

Exercise 3.6 

Determine whether the following causal LTI second-order differential system is 
stable: 


7 d 2 y(t ) „ dyjt) 
dt 2 dt 


24 y(t) = — x(t)~ 4x(t). 
dt 


Exercise 3.7 

Consider the following first-order, causal LTI difference system: 

2y[n\ + 1 .2 y[n - 1] = x[n - 1], 

Compute the impulse response h[n] of the system by using recursion. 
Answer: 

ON THE CD 


Exercise 3.8 

Suppose that a $1000 deposit is made at the beginning of each year in a ha nk ac- 
count carrying an annual interest rate of r = 6%. The interest is vested in the ac- 
count at the end of each year. Write the difference equation describing the 
evolution of the account and find the amount accrued at the end of the 50th year. 
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Exercise 3.9 

Find the impulse response h(t) of the following second-order, causal LTI differen- 
tial system: 


0(0 

dt 2 




dt 


dt 


Answer: 



mmco 


Exercise 3.10 


Compute and sketch the impulse response h(t) of the following causal LTI, first- 
order differential system initially at rest: 

2 + 4y (t) = 3 — x(t) + 2x(t). 

dt ' ' dt 


Exercise 3.11 

Compute the impulse response h[n] of the following causal LTI, second-order dif- 
ference system initially at rest: 

y\n\ + \fly\n - 1] + y[n - 2] = x[n - 1] + x[n - 2\. 

Simplify your expression of h[n] to obtain a real function of time. 

Answer: 

ON THE CD 


Exercise 3.12 

Calculate the impulse response h(t) of the following second-order, causal LTI dif- 
ferential system initially at rest: 


d 2 y(t) 
dt 2 


+ 2 M) + 2j(( ) = - 3 


+ x(t). 


dt 


dt 
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Exercise 3.13 

Consider the following second-order, causal difference LTI system S initially at rest: 
S : y\n\ - 0.9 y[n - 1] + 0.2 y[n - 2] = x[n - 1]. 

(a) What is the characteristic polynomial of SI What are its zeros? Is the sys- 
tem stable? 

(b) Compute the impulse response of S for all n. 

(c) Compute the response of S for all n for the input signal x\n\ = 2 u[n\ using 
the conventional solution (sum of particular solution and homogeneous 
solution). 


Answer: 
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((Lecture 12: Definition and Properties of the Fourier Series)) 


A signal is defined as a function of time representing the evolution of a vari- 
able. Certain types of signals have the special property of remaining basi- 
cally invariant under the action of linear time-invariant systems. Such 
signals include sinusoids and exponential functions of time. These signals can be 
linearly combined to form virtually any other signal, which is the basis of the 
Fourier series representation of periodic signals and the Fourier transform repre- 
sentation of aperiodic signals. 
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The Fourier representation opens up a whole new interpretation of signals in 
terms of their frequency contents, called their frequency spectrum. Furthermore, in 
the frequency domain, a linear time-invariant system acts as a filter on the fre- 
quency spectrum of the input signal, attenuating it at some frequencies while am- 
plifying it at other frequencies. This property is called the frequency response of 
the system. These frequency domain concepts are fundamental in electrical engi- 
neering, as they underpin the fields of communication systems, analog and digital 
filter design, feedback control, power engineering, etc. 

Well-trained electrical and computer engineers think of signals in terms of 
their frequency spectrum probably just as much as they think of them as functions 
of time. 


LINEAR COMBINATIONS OF HARMONICALLY RELATED 
COMPLEX EXPONENTIALS 


Recall that periodic signals satisfy x( t) = x( t + T), - °° < t < +°° for some positive 
value of T. The smallest such T is called the fundamental period of the signal, and 
its fundamental frequency is defined as 0 ) u = y rad/s . One thing to remember is 
that the periodic signal x(t) is entirely determined by its values over one period T. 
Also recall that we looked at harmonically related complex exponentials with fre- 
quencies that are integer multiples of t o 0 : 

^ k (t):=e jk ^, k = 0,±1,±2„... (4.1) 


We saw that these harmonically related signals have a very important property: 
they form an orthogonal set. That is, 


2n 

(O n 


2 n 
co n 


2 n 
co n 


J 0*(O0_ m (O* = J e>ka,fe Jma °'dt = J e 

0 0 

- — r 

- t: L 


j(m-k)(D a t 


J(m-k) 2k 


j(m-k)O) 


dt 


2k , 

— , in — k 
O ) 0 

0, m jk k 


(4.2) 


Each of these signals has a fundamental frequency that is a multiple of co 0 , and 
therefore each is periodic with period T (although for /i > 1 , the fundamental pe- 
riod of <f> k (t) is T). Let us look at the imaginary part of 0 At) for k = 0,1,2 and 
T = Is shown in Figure 4.1. 
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FIGURE 4.1 Imaginary parts of complex harmonics. 


A linear combination of the complex exponentials ) is also periodic with 
fundamental period T: 


+°° +°° ,2tT 

x{t) = a k e jk< ""' = a k e T . (4.3) 

k =— oo k =— oo 

The two terms with k = ± 1 in this series are collectively called the fundamen- 
tal components, or the first harmonic components, of the signal. The two terms 
with k = ±2 are referred to as the second harmonic components (with fundamen- 
tal frequency 2 a > 0 ), and more generally the components for k = ±N are called the 
N th harmonic components. 

Example 4.1: Consider the periodic signal with fundamental frequency 

co Q =n/ 2 rad/s made up of the sum of five harmonic components: 

T4 jk—t 

x( t) = 2 j a k e 1 , 

k=-5 

a Q = 0 , a ±l = -0.2026, a^ = 0 , 

a + 3 = -0.0225, a +A = 0, a +5 = -0.008 1 . (4.4) 

Collecting the harmonic components together, we obtain 

.n .n ,?>ji .3 n .5 n .57T 

x(t) = - 0.2026(e Jjl +e~ J ^)-0.0225(e Y ' + e~ JY ')- 0.008 1( e^ +e“' T ') 

jt Sk 

= -0.4052 cos(— t)-0.0450cos(— t) — 0.0162cos(— t) 


(4.5) 
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The resulting signal represents an approximation to a triangular wave, as seen 
in Figure 4.2. 

0.5 
0.4 
0.3 
0.2 
0.1 
0 

- 0.1 
- 0.2 
- 0.3 
-04 
- 0.5 

- 4 - 3 - 2-101234 

I 

FIGURE 4.2 Signal as a sum of five harmonic components. 


DETERMINATION OF THE FOURIER SERIES REPRESENTATION OF 
A CONTINUOUS-TIME PERIODIC SIGNAL 

Assume that a periodic signal can be expressed as a linear combination of har- 
monically related signals as in Equation 4.3. Then, by the orthogonality property of 
the harmonically related complex exponentials, we can easily compute the a k co- 
efficients. To obtain a n , we just have to multiply both sides of Equation 4.3 by 
e~i n<0 o' and integrate over one fundamental period of the signal (here from 0 to T, but 
it could be from any time t 0 to time t Q + T , which is denoted as JO*): 

T 

T T + oo 

J x(t)e jn ^dt = J X a k e jk% 1 e- jn ° v dt 

0 0 

-too T 

= X a k J e Jk<a ° l e~ Jm> ° , dt 

k=—°° 0 



x(t) 

7 i 

-y, V-J 

f \ ,, \ 

■ j~T ;-\ j 

-0.0 162 cos( — i) 

-0.0450cos(— /) 

2 

L /; 2 

r \ \ 

A , 


./ -0.4052 cos(^/> 



= Ta . 


(4.6) 
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Thus, a n =^x{t)e Jim °'dt. 

1 o 

To recap, if a periodic signal x(t ) has a Fourier series representation, then we 
have the equation pair 


+°° +°° /27T, 

x(t)= Yj a k e jk0>n ' = ^ a k e T , (4.7) 


a k = ^ jx(t)e Jkc0o 'dt = ^ j x(t)e r< T > dt, (4.8) 

which gives us two representations of the signal. Equation 4.7 is a time-domain 
representation of the signal as a sum of periodic complex exponential signals. This 
is the synthesis equation. Equation 4.8, called the analysis equation, gives us a fre- 
quency-domain representation of the signal as the Fourier series coefficients, also 
referred to as the spectral coefficients of x(t). That is, each one of these complex 
coefficients tells us how much the corresponding harmonic component of a given 
frequency contributes to the signal. 

Remarks: 

■ The coefficient a 0 = — J x(t)dt is the DC component of the signal (average 

value of the signal over one period). It should always be computed separately 
from a k to avoid indeterminacies of the type 0/0 in the expression for a k eval- 
uated at k = 0 . 

■ For a real signal x(t), we have a_ k = a*. Let a ; = A, f &k , A k ,6 k e R . Then we 
have a real form of the Fourier series: 

+oo +oo 

x{t) = X a k e jk< °°‘ = a 0 + 

k=-o o k= 1 

+oo 

= a 0 + ^2R Q{ a k e^' } 

k = 1 

Too 

= a o + 2 X A k cos (kcof + G k ). (4.9) 

k = 1 


■ For a real signal x(t), if we represent the Fourier series coefficients as 
a k = B. + jC k , B k ,C k g R, we obtain another real form of the Fourier series: 
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x(t)= X 


k=~ 


jkco a t . \ ’ ikcoj , * - ikcoj 

a k e 0 = %+ \ a k e +a k e 

k = 1 


= a 0 + ^2Re { a k e jk(O °'} 


k = 1 

+oo 


= a o + X 2Rc ‘ (Z? < + jC k )[cos(kco O 0 + jsin(kca 0 t)]} 

k = 1 

+oo 

cos( A'(O 0 ?) - Cj. sin(/rm () 0] 


~ a o + 


(4.10) 


k= 1 


Example 4.2: Let us find the fundamental period T, the fundamental frequency 

co 0 , and the Fourier series coefficients a k of the periodic “sawtooth” signal x(t) 
shown in Figure 4.3. Then, we will express x(t) as a Fourier series. 



FIGURE 4.3 Periodic "sawtooth" signal. 


The fundamental period is T = Is ; hence co Q = 2n rad/s . First, the average 
over one period (the DC value of the signal) is 0, so a Q = 0 . For k * 0 , 

a k =-\x(t)e }k2m dt 
T o 

i 

= J (1 - 2 t)e~ Jk2K, dt 


= — — I” (1 - 2 t)e ik2m 1 — [ e jk2m dt (integration by parts) 

jk2n L Jo jkn J 0 


=o 
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1 1 

1 

jkln jkln 

1 

jkn 

(4.11) 

kn 


Note that the coefficients a k = ^ are purely imaginary and form an odd 
sequence, which is consistent with our real, odd signal. The Fourier series repre- 
sentation of x(t ) is 


x(t)= - 


I 


J_gjk2nt 

kn 


(4.12) 


GRAPH OF THE FOURIER SERIES COEFFICIENTS: 
THE LINE SPECTRUM 


The set of complex Fourier series coefficients ( a It” of a signal can be plotted 
with separate graphs for their magnitude and phase. The combination of both plots 
is called the line spectrum of the signal. 


Example 4.3: Consider the Fourier series coefficients of the sawtooth signal 

obtained in the previous example. Their magnitudes are given by \a k \= yz , 


k 0 , and a 0 = 0 , and their phases are given by Za t 



k> 0 

and 

k< 0 


Za 0 = 0 . The corresponding line spectrum is shown in Figure 4.4. 



ON THE CD 


The following MATLAB M-file located in D:\Chapter4\linespectrum.m dis- 
plays the line spectrum of the sawtooth signal. 
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Za,. 



FIGURE 4.4 Line spectrum of the sawtooth signal. 


%% Line spectrum of Fourier series coefficients 
% signal amplitude and period 
A-i ; 

T=1; 

% number of harmonics 
N=10; 

% first compute the ak’s 
a0=0; 

spectrum=zeros(1 ,2*N+1 ) ; 
for k=-N:N 

% spectral coefficients of sawtooth signal 
if k>0 

eval(['a’ num2str(k) ‘=-j *A/ (k*pi) ’ ] ) 
eval( [ ' spectrum(k+N+1 )=a’ num2str(k) ] ) ; 
elseif k<0 

eval([‘a_’ num2str(abs(k) ) ‘ =- j *A/ ( k*pi) ’ ] ) 
eval( [ ‘spectrum(k+N+1 )=a_’ num2str(abs (k) ) ] ) ; 
end 
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eval( [ ' spectrum(N+1 )=a0’ ] ) ; 
end 

% line spectrum 
K= [ - N : N ] ; 
subplot (21 1 ) 
st em(K,abs( spectrum) 
subplot (212) 

stem (K, phase (spectrum) ,’.-’) 


Remark: A co mm on mistake is to forget that the magnitude line spectrum must 

always be nonnegative. This mistake might arise, for example, when one writes 
\a k \= Y n :, which is obviously wrong since k can be negative. 

PROPERTIES OF CONTINUOUS-TIME FOURIER SERIES 


Note that if the periodic signal x(t) admits a Fourier series representation, then its 
set of spectral coefficients {a determines x(t) completely. The duality be- 
tween the signal and its spectral representation is denoted as x(t) <-> a k . The fol- 
lowing properties of the Fourier series are easy to show using Equations 4.7 and 
4.8. (Do it as an exercise.) Note that these properties are also listed in Table D.3 of 
Appendix D. 

Linearity 

The operation of calculating the Fourier series coefficients of a periodic signal 

FS FS 

is linear. For x(t)<->a k , if we form the linear combination 

z(t) = ax(t) + f3y(t), a,/Je<C,then 

FS 

z(t)<r J >aa k + (3b k . (4.13) 


Time Shifting 

FS 

Time shifting leads to a multiplication by a complex exponential. For x(t)<-^a k , 

FS , 

x(t-t 0 )<r->e 1 "’""a k . 


(4.14) 
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Remark: The magnitudes of the Fourier series coefficients are not changed, only 

their phases. 

Time Reversal 

Time reversal leads to a “sequence reversal” of the corresponding sequence of 
Fourier series coefficients: 

FS 

x(-t)<r^a_ k . (4.15) 

Interesting consequences are that 

■ For x(t) even, the sequence of coefficients is also even ( a_ k = a k ). 

■ For x(t) odd, the sequence of coefficients is also odd ( a_ k = ~a k ). 

Time Scaling 

Time scaling applied on a periodic signal changes the fundamental frequency of 
the signal (but it remains periodic “with the same shape”). For example, x (at) has 
fundamental frequency aco 0 and fundamental period or 1 71 The Fourier series co- 
efficients do not change: 


FS 

x{at)<r^a k , (4.16) 

but the Fourier series itself has changed, as the harmonic components are now at 
the frequencies ±aco 0 , + 2 aco 0 , + 3 aa> 0 

Application: For a given periodic signal (a specific waveform) such as a square 

wave, one can compute the Fourier series coefficients for a single normalized fun- 
damental frequency. Then, the Fourier series of a square wave of any frequency has 
the same coefficients. 


Multiplication of Two Signals 

FS 

Suppose that x(t) and y(t) are both periodic with period T. For x(t)<r^a k , 

FS 

y(t)<r^b k , we have 


fs 

x(t)y(t)^2. a A-/ 


/=— OC 


(4.17) 
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that is, a convolution of the two sequences of spectral coefficients. 

Conjugation and Conjugate Symmetry 

Taking the conjugate of a periodic signal has the effect of conjugation and index re- 
versal on the spectral coefficients: 


FS 

x*(t)<r^a*_ k . (4.18) 

Interesting consequences are that 

■ For x(t) real, x(t) = x*(t) and the sequence of coefficients is conjugate sym- 
metric ; that is, a_ k =a* k . This implies \ a ^ k \ = \ a k \ (magnitude is even), 
Za k = ~Za k (phase is odd), a Q e R, Re{a_ A _} = Re{ar,.}, \m{a k } = -\m{a k ). 

■ For x(t) real and even, the sequence of coefficients is also real and even 

( a_ k = a k e R). 

■ For x(t) real and odd, the sequence of coefficients is imaginary and odd 

( a_ k = — a k purely imaginary). 

■ For an even-odd decomposition of the signal x(t) = xft) + x o (t), we have 

FS FS 

x (0<->Re{a t }, x o (t)<r^jlm{a k }. 

((Lecture 13: Convergence of the Fourier Series)) 


FOURIER SERIES OF A PERIODIC RECTANGULAR WAVE 


Consider the following periodic rectangular wave (or square wave) of fundamen- 

2.71 

tal period T and fundamental frequency co 0 = fr (see Figure 4.5). 
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FIGURE 4.5 Periodic rectangular wave. 
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This signal is even and real and hence its Fourier series coefficients are also 
real and form an even sequence. Its DC value is equal to the area of one rectangle 
divided by the period: a 0 = — f . The other spectral coefficients are obtained as 
follows: 


a k 




1 

jk(O 0 T 



_ e J kto Jo 
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( e i kl0 J o 


kco 0 T 


V 


sm 


f 2 1 A 

71 k 0 

T 


nk 


_ e ~j km J 0 

V 

k*0. 




J 


2 sin( k(O Q t 0 ) 
kc»T 


(4.19) 


As previously mentioned, the coefficient a 0 is the signal average over one 
period. The other coefficients are scaled samples of the real continuous sine func- 
tion defined as follows: 


sinc(i<) := ^ nKU ; u e M. (4.20) 

nu 

This function is equal to one at u = 0 and has zero crossings at u = ±n, 
n = 1,2,3,. . . , as shown in Figure 4.6. 



FIGURE 4.6 Graph of the sine function. 
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2 1 

Now, define the duty cycle ?y := T ' of the rectangular wave as the fraction of 
time the signal is “on” (equal to one) over one period. The duty cycle is often given 
as a percentage. The spectral coefficients expressed using the sine function and the 
duty cycle can be written as 


2 t 


sm 


1 nk2t 0 ^ 


nk2t„ 


2t » ■ 

= — -smc 

T 


f k2t^ 

V T J 


= iisincfkijj. 


(4.21) 


For a 50% duty cycle, that is, TJ= ' , we get the Fourier series coefficients 
given in Equation 4.22 and whose line spectrum is shown in Figure 4.7. Note that 
the coefficients are real, so a single plot suffices. Flowever, one could also choose 
to sketch the magnitude (absolute value of a k ) and the phase (0 for a k nonnegative, 
-n/2 for a k negative) on two separate graphs. 


a. 

k 


1 • f 

2 l 


k' 

2/ 


(4.22) 



FIGURE 4.7 Spectral coefficients of the rectangular wave for a 
50% duty cycle. 


Remember that k is a multiple of the fundamental frequency. So for a 60 FIz 
(12071 rad/s) square wave, the coefficients a +1 are the fundamental components at 
60 FIz, a ± j are the second harmonic components at 120 FIz, etc. 

For shorter duty cycles (shorter pulses with respect to the fundamental pe- 
riod), the “sine envelope” of the spectral coefficients expands, and we get more co- 
efficients in each lobe. For example, the real line spectrum of a rectangular wave 

with 11 ~ 1 is shown in Figure 4.8. 

8 
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t A (r? = 


0.125 



FIGURE 4.8 Spectral coefficients of the rectangular wave for a 
duty cycle r\ — i. 


Remarks: 

■ In general, the coefficients are complex, and one would have to sketch two 
graphs to represent them (magnitude and phase). 

■ For a long duty cycle tending to 1 , the waveform approaches a constant signal, 
and at the limit all the spectral coefficients vanish except the DC value: a = 1 . 

■ For a short duty cycle tending to 0, there are more and more lines in the main 
lobe of the sine envelope. In fact, the first zero crossings bounding the main 
lobe are at k = ±- when these numbers turn out to be integers. This means that 
a periodic signal with short pulses has several significant harmonic compo- 
nents at high frequencies. This observation holds true in general for other sig- 
nals in that signals with fast variations display significant high-frequency 
harmonics. 

c j ■ The interactive Fourier Series Applet on the companion CD-ROM located in 
mccD D:\Applets\FourierSeries\FourierApplet.html can help visualize the decompo- 
sition of a signal as a sum of harmonic components. 


OPTIMALITY AND CONVERGENCE OF THE FOURIER SERIES 


To study the convergence of the Fourier series, let us first look at the problem of 
approximating a periodic signal with a finite sum of harmonics (a truncated version 
of the infinite sum). The question here is as follows: What coefficients will give us 
the “best” approximation to the signal? Let the truncated Fourier sum be defined as 

+N 

x N (t)-= X a k e jk% ‘, 

k--N 


(4.23) 
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and define the approximation error as 


e N {t) \= x(t)-x N (t) = x(t)~ X a k e jk(0 °‘. (4.24) 


Now, consider the energy in one period of the error signal as the quantity to 
minimize to get the best approximation. 


= dt. 


(4.25) 


We proceed by first expanding this equation: 


1 +YV 

J x(t)- ^ 


Jk* o' 


*w- X a k 


-jk(0„t 


dt 


1 1 +j\ +i\ 1 +yv J +i\ 

^ x{t)x* (t)dt + J ^ a k e jk( ° ot ^ a*e jn( ° ot afr — Jjc(f) ^ jk( ° ot dt — a k e jk( ° ot dt 

0 0 \k=-N J\n=-N / 0 *=-# 0 

T +N N T +N T +N T 

\Mdt + ]T a k aj je J{k ~" )%, dt- ^ a* jx(t)e~ jkm °‘dt - ^ a k jx*{t)e jl ““° l dt 

0 k=-N n=-N 0 k=-N o k=-N o 

T +N +N T +N T 

J|x(f)| dt + T ^ a k a k ~ S a k J x (0 e ~ jk(0(>t dt - ^ a k ^ x*(t)e jk( ° ot dt. (4.26) 


k=-N o 


Then, we write the coefficients in rectangular coordinates a k = a k + jfi k and 
seek to minimize the energy E N (a k ,P k ) by taking its partial derivatives with re- 
spect to a k and ft k and setting them equal to zero. Let us do it for the real part a k : 

= J \x(t)\ dt + T 2) (a k +P k )- X (a k - jP k )]x(t)e~ jka °'dt- ^ (a k + jP k )jx*(t)e jk% ‘dt 


k=-N 

+N 


k=-N 

+N 


k=-N 

+N 


T +N +N f T 1 +N f T j 

= \\x(t)\ dt+T 2) (a k +P k )-2 a t Rel ^ P k \mUx{t)e~ lka,/ dt\. (4.27) 

0 k=-N k=—N [o J t=-w [o J 


Differentiating with respect to a k , we obtain 


da, 


= 2T £ a k - 2 £ Re H x(t)e~ ikm °' dt \ = 0. 


(4.28) 


This equation is satisfied with a k = Re yf\ x(t)e . Similarly, minimizing the 
energy of the approximation error with respect to ft k yields P k = Im j ' J-U/jc Jhv dt \ . 


Therefore, the complex coefficients a k = -J x(t)e 1 " dt minimize the approxi- 
mation error. 
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If the signal x(t) has a Fourier series representation, then the limit of the energy 

i |2 

in the approximation error E N = j e (?) dt as A tends to infinity is zero. In this 
sense, the Fourier series converges to the signal x(t). 


EXISTENCE OF A FOURIER SERIES REPRESENTATION 


What classes of periodic signals have Fourier series representation? One that does 
is the class of periodic signals with finite energy over one period (finite total aver- 
age power), that is, signals for which 

J|x(?)| dt<° (4.29) 

T 

These signals have Fourier series that converge in the sense that the power in 
the difference between the signal and its Fourier series representation is zero. Note 
that this does not imply that the signal x(?) and its corresponding Fourier series are 
equal at every value of time t. The class of periodic signals with finite energy over 
one period is broad and quite useful for us. 

Another broad class of signals that have Fourier series representation are sig- 
nals that satisfy the three Dirichlet conditions. These signals equal their Fourier 
series representation, except at isolated values of t where x(t) has finite disconti- 
nuities. At these times, the Fourier series converges to the average of the signal 
values on either side of the discontinuity. 

Dirichlet Conditions 

Condition 1: Over any period, x(t) must be absolutely integrable; that is, 

J|x(?)|c/? < 00 

T 

Condition 2: In any finite interval of time, x(?) must be of bounded varia- 

tions. This means that x(?) must have a finite number of maxima and minima 
during any single period. 

Example 4.4: The signal x (?) = sin , 0 < t < 1 does not meet this require- 

ment, as it has an infinite number of oscillations as time approaches zero. 

Condition 3: In any finite interval of time, x(t) has a finite number of dis- 

continuities. Furthermore, each of these discontinuities is finite. 
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GIBBS PHENOMENON 



ON THE CO 


An interesting observation can be made when one looks at the graph of a truncated 
Fourier series of a square wave. This is easy to do using, for example, MATLAB: 
compute the spectral coefficients as given in Equation 4.21 and up to k = ±l 
( N = 7) and plot the real approximation to the square wave signal. The MATLAB 
M-file Fourierseries.m located in D:\Chapter4 on the companion CD-ROM can be 
used. 


, (0 := X a k eJkl °°' = a 0 + 2 X a k cos(/my). 


(4.30) 


The graph over one period looks like the one in Figure 4.9. 



FIGURE 4.9 Gibbs phenomenon for truncated 
Fourier series of a square wave with seven 
harmonic components. 


We can see that there are ripples of a certain amplitude in the approximation, 
especially close to the discontinuities in the signal. The surprising thing is that the 
peak amplitude of these ripples does not diminish when we add more terms in the 
truncated Fourier series. For example, for N = 19 in Figure 4.10; the approxima- 
tion gets closer to a square wave, but we can still see rather large, but narrow, rip- 
ples around the discontinuities. 

This is called the Gibbs phenomenon after the mathematical physicist who 
first provided an explanation of this phenomenon at the turn of the twentieth cen- 
tury. Indeed, the peak amplitude does not diminish as N grows larger, and the first 
overshoot on both sides of the discontinuity remains at 9% of the height of the dis- 
continuity. However, the energy in these ripples vanishes as N — > +°° . Also, for 
any fixed time t t (not at the discontinuity), the approximation tends to the signal 
value x M (t.) — > x(t . ) (this is called pointwise convergence). At the discontinuity 
for time t 0 , the approximation converges to a value corresponding to half of the 
jump. 
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FIGURE 4.10 Gibbs phenomenon for a truncated Fourier 
series of a square wave with 19 harmonic components. 



((Lecture 14: Parseval Theorem, Power Spectrum, Response of LTI System to Pe- 
riodic Input)) 


FOURIER SERIES OF A PERIODIC TRAIN OF IMPULSES 


It would be useful to have a Fourier series representation of a periodic train of im- 
pulses, called an impulse train as shown in Figure 4.1 1. 


1 

v(t) 

-_L±J 

- 27 * -T 

1 1 t: 

T IT 3 T 


FIGURE 4.1 1 Impulse train. 


A train of singularity functions such as impulses does not meet the Dirichlet 
conditions, nor is it of finite energy over one period. We can nevertheless calculate 
the Fourier series coefficients of the impulse train v(t) = X 8(t — nT ) by using 
the formula " = “ 


1 772 

a k = f\ 5 C> 


,-jka> 0 ti _ 


dt = — . 


(4.31) 
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*■ a* 


FIGURE 4.12 Spectral coefficients of the impulse 
train. 


We can see in Figure 4.12 that the spectrum of an impulse train is a real, con- 
stant sequence. This means that the impulse train contains harmonics of equal 
strength at all frequencies, up to infinity. 


Example 4.5: A periodic signal x(t) can be described as a convolution of a sin- 

gle period of the signal with a train of impulses as shown in Figure 4.13. Let 


x T (t) := 



0 <t<T 

otherwise 


. Then, 


x(t)= ^8(t-nT)*x T (t) 

n=—°o 
+°° +oo 

= J ^ 8(t - nT)x T (t - T)dr 

_oo «=— oo 
+00 +°° 

= | 8{T-nT)x T (t-T)dT 

«=-oo _ 00 
+oo 

= ^ x T (t ~ nT)- (4.32) 

n =— oo 


no= -i'll') 



... ^ ' 

x(t) 

!a /\ . 

-T V 

< 

<: 



>$ 

II 

X 


\/t ' t 


FIGURE 4.13 Conceptual setup for generating a periodic signal. 
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The Fourier series coefficients of the periodic signal x(t) are obtained by mul- 
tiplying the spectrum (Fourier transform) of x T ( t ) by the spectrum of the impulse 
train (more on this later when we study the Fourier transform). 

The operation of periodically sampling a continuous-time signal can also be 
conveniently represented by a multiplication of an impulse train with the signal, as 
depicted in Figure 4.14. Sampling will be studied in detail in Chapter 15. 



FIGURE 4.14 Conceptual setup for signal sampling. 


PARSEVAL THEOREM 


The Parseval theorem or Parseval equality simply says that the total average power 
of a periodic signal x{t) is equal to the sum of the average powers in all of its har- 
monic components. 

The power in the k ,h complex harmonic a e jk<0 °' of a periodic signal is given by 



(4.33) 


Note that P k = P k , so the total power of the k ,h harmonic components of the 
signal (i.e., the total power at frequency kco 0 ) is 2 P k . 

The total average signal power is given in the frequency domain by the Parse- 
val theorem, which can be derived using the orthogonality property of the complex 
harmonics: 


p = l -\\M dt = X k 

f k=-oo 


(4.34) 


This elegant result basically states that the total average power of a signal can 
be computed using its frequency domain representation. We will see in the next 
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section that we can compute the average power of a signal in different frequency 
bands. It makes the Parseval theorem very useful to, for example, electrical engi- 
neers trying to figure out the power losses of a signal transmitted over a communi- 
cation channel at various frequencies. 

Example 4.6: Let us compute the total average power in the unit-amplitude 

square wave of period T and 50% duty cycle. We have already computed its spec- 
tral coefficients: a k = - sine [ — ] - First, using Parseval’s relation in the frequency 
domain, we obtain 




k=- 
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— sine — 
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(4.35) 


Now we check this result against the time-domain formula to compute the 
power: 


1 r, ,2 1 T, r , 1 

^ = -J|x(0| dt = - J 1 dt = - 


-T/4 


f j 1 j" 1 A 

v 4 + 4 y 


2 ' 


(4.36) 


POWER SPECTRUM 


The power spectrum of a signal is the sequence of average powers m each complex 
l l 2 

harmonic: \aA . For real periodic signals, the power spectrum is a real even se- 
quencers \a_ k \ = \ a k\ ■ 

Example 4.7: The power spectrum of the unit-amplitude rectangular wave with 

duty cycle ij - i is given by aj = /psinc 2 (/rp)= sinc 2 (|). This power spec- 
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tram is shown in Figure 4.15. We can see that most of the power is concentrated at 
DC and in the first seven harmonic components, that is, in the frequency range 
[—if , l4;r J rad/s. 



FIGURE 4.1 5 Power spectrum of the rectangular wave of duty 
cycle p = \ 


Example 4.8: The Fourier series coefficients and the power spectrum of the sine 
wave x(t) = Asin(a> 0 t) can be easily computed using Euler’s formula: 

x(t) = Asin(a> 0 t) = Yj (e J< °° ' ~ e~ J<0 °‘), so that a t = ~j \ , a_ x = j f , a k = 0, 

II 2 I I 2 a 2 

k^± 1 . The power spectrum shown in Figure 4. 16 is given by a, “ | a -i | “ T anc * 

l l 2 j 2 

\a k | = 0, k ^ +1, and the total average power is p = £. 

i i2 

\a k \ 
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k 


FIGURE 4.16 Power spectrum of a sine wave. 
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TOTAL HARMONIC DISTORTION 


Suppose that a signal that was supposed to be a pure sine wave of amplitude A is 
distorted, as shown in Figure 4.17. This can occur in the line voltages of an indus- 
trial plant making heavy use of nonlinear loads such as electric arc furnaces, solid 
state relays, motor drives, etc. 



FIGURE 4.17 Distorted sine wave. 


Clearly, some of the harmonics for k ^ ±1 are nonzero in the signal x(t) shown 
in Figure 4. 17. One way to characterize the distortion in the signal is to compute the 
ratio of average power in all the harmonics that “should not be there,” that is, for 
\k\ > 1 , to the total average power of the sine wave, that is, the power in its funda- 
mental components. The square root of this ratio is called the total harmonic dis- 
tortion (TF1D) in the signal. 

Let us first define a classical quantity in electrical engineering called the RMS 
value of a periodic signal (RMS stands for root mean square): 



The RMS value is a measure of the power in a signal, but the square root is 
taken to get back to the units of volt or ampere when one works with voltage or cur- 
rent signals. 

Notice that the quantity inside the square root is nothing but the total average 
power P . From the Parseval theorem, we have 


X 


RMS 



(4.38) 
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Thus, assuming that the signal is real and a 0 = 0, we have X RMS = ^^2 a t \ 

and we can define the total harmonic distortion in this periodic signal as the ratio 
of the RMS value of all the higher harmonics for k > 1 ( the distortion) to the RMS 

value of the fundamental (the pure sine wave) which is J 2 a { 2 : 


THD := 1 OCh 


%. 


(4.39) 


This definition of THD is the one generally adopted in power engineering, and 
other areas of engineering, although audio engineers often use a different defini- 
tion, which compares the RMS value of the distortion to the RMS value of the dis- 
torted sine wave: 



(4.40) 


Example 4.9: For the distorted sine wave of Figure 4.17, suppose the power 

spectrum is as given in Figure 4.18, where |aj~ = 0, \k\ > 5. Figure 4.18 illustrates 
how the THD is computed. 



sine wave. 
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STEADY-STATE RESPONSE OF AN LTI SYSTEM 

TO A PERIODIC SIGNAL 

We have seen that the response of an LTI system with impulse response h(t) to a 
complex exponential signal e st is the same complex exponential multiplied by a 
complex gain: y(t) = H(s)e st , where 

+oo 

H(s)= \h(T)e sx dT. (4.41) 

In particular, for s = jco , the output is simply y(t) = H(ja>)e ico ' . The complex 
functions H(s) and H(jco) are called the system’s transfer function and fre- 
quency response, respectively. 

By superposition, the output of an LTI system to a periodic input signal repre- 

+°° ., 

sented by a Fourier series x(t) = £ a k e J %l is given by 

k=-°° 

y(t) = jr a k H (jkco 0 )e ]k%t , (4.42) 

k =-> o 

which is itself a Fourier series. That is, the Fourier series coefficients b k of the 
periodic output y(t) are given by: 

b k = a k H (jk(O 0 ). (4.43) 

This is an important fact: The effect of an LTI system on a periodic input 
signal is to modify its Fourier series coefficients through a multiplication by its 
frequency response evaluated at the harmonic frequencies. 

Example 4.10: Consider a periodic square wave as the input to an LTI system of 

impulse response h(t) and frequency response H(jco) . The spectrum of the output 
signal of the system is shown in Figure 4.19. 



k 


FIGURE 4.19 Effect of an LTI system on a periodic input in the frequency domain. 
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Remarks: 

■ It is assumed that the system is in steady-state; that is, it has been submitted to 

the same input from time t = . Thus, there is no transient response from ini- 

tial conditions in the output signal. 

■ If the system is unstable, then the output would tend to infinity, so we assume 
that the system is stable. 


Filtering 

Filtering is based on the concepts described earlier. Filtering a periodic signal with 
an LTI system involves the design of a filter with a desirable frequency spectrum 
H(jkco 0 ) that retains certain frequencies and cuts off others. 

Example 4.11: A first-order lowpass filter with impulse response h(t) = e~‘u(t) 

(a simple RC circuit with RC = I ) cuts off the high-frequency harmonics in a 
periodic input signal, while low-frequency harmonics are mostly left intact. The 
frequency response of this filter is computed as follows: 

e~ T e ~ jm dz = — - — (4.44) 

1 + ja> 

We can see that as the frequency co increases, the magnitude of the frequency 
response of the filter |/f(y'co)| = decreases. If the periodic input signal is a 
unit-amplitude rectangular wave of duty cycle r], then the output signal will have 
its Fourier series coefficients b k given by: 


b, = a l HUh 0t )= Vilxm , k* 0. 
* * ° (1 + jkco Q y 

(4.45) 

b 0 = a 0 H (0) = a 0 = n- 

(4.46) 


The reduced power at high frequencies produces an output signal that is 
“smoother” than the input signal. Remember that discontinuities can only result 
from a significant contribution of high-frequency harmonic components in the 
Fourier series, so when these harmonics are filtered out, the result is a smoother 
signal, as shown in Figure 4.20. 


H{jco)= J 

0 



Fourier Series Representation of Periodic Continuous-Time Signals 


157 



FIGURE 4.20 Effect of a first-order, low-pass filter on a 
rectangular wave. 


SUMMARY 


This chapter introduced the frequency- domain interpretation of periodic continu- 
ous-time signals. 

■ We have shown that most periodic continuous-time signals can be decom- 
posed as an infinite sum of complex harmonics using the Fourier series. These 
include finite-power signals and signals satisfying the Dirichlet conditions. 

■ Complex harmonics are periodic complex exponential signals of fundamental 
frequency equal to an integer times the fundamental frequency of the signal. 
These harmonics were shown to be orthogonal. 

■ The line spectrum and power spectrum plots of a periodic signal are based on 
its Fourier series coefficients and indicate the relative importance of the dif- 
ferent harmonic components making up the signal. The total harmonic distor- 
tion in a signal approximating a pure sine wave can be computed from the 
power spectrum of the signal. 

■ The Gibbs phenomenon was shown to produce oscillations in the truncated 
Fourier series approximation of a signal around first-order discontinuities. 

■ Finally, filtering was introduced as the action of an LTI system on the Fourier 
series coefficients of the input signal to either amplify or attenuate the har- 
monic components at different frequencies. 


TO PROBE FURTHER 


Further information on Fourier series can be found in Brown and Churchill, 2001. 
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EXERCISES 


Exercises with Solutions 

Exercise 4.1: Fourier Series of the Output Voltage of an Ideal Full-Wave Diode 
Bridge Rectifier 

The nonlinear circuit in Figure 4.21 is a full-wave rectifier. It is often used as a first 
stage of a power supply to generate a constant voltage from the 60 Hz sinusoidal line 
voltage for all kinds of electronic devices. Here the input voltage is not sinusoidal. 



The voltages are V «« (0= ji 8 ^~ kT ^ [4^^ ~ U ^- f } ), and 

v (0 = |v,(0|- 

(a) Let T ] be the fundamental period of the rectified voltage signal v(t) and let 
(O l = 2njT x be its fundamental frequency. Find the fundamental period T y 
Sketch the input and output voltages v. (/), v(t) . 


Answer. 

Let us first sketch the input voltage, which is the periodic sawtooth signal shown 
in Figure 4.22. Then the output voltage is simply the absolute value of the input sig- 
nal that results in a triangular wave as shown in Figure 4.23. 



FIGURE 4.22 Input voltage of the full-wave rectifier. 
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v{t) 



FIGURE 4.23 Output voltage of the full-wave rectifier. 


We can see that the fundamental period of the output signal is the same as that 
of the input: T X = T . 

(b) Compute the Fourier series coefficients of v jn ( t ) . Sketch the spectrum for 
A = 1. 


Answer. 

The DC component of the input is obviously 0: 


for k ■£ 0 : 
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The spectrum is imaginary, so we can use a single plot to represent it as in Fig 
ure 4.24. 
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FIGURE 4.24 Line spectrum of input voltage, case A = 1 . 


(c) Compute the Fourier series coefficients of v{t). Write v(t) as a Fourier se 
ries. Sketch the spectrum for A = 1 . 


Answer. 

Let us first compute the DC component of the output signal: 


TJ 2 


A V 2 


= - f 

T J 


4 A 


TJ 2 


a„ = — — \t\dt = — - tdt - — = —A. 


J tdt = 


4 A _ 1 


1 o 


1 -TJ 2 1 

For k ^ 0 , the spectral coefficients are computed as follows: 


TJ 2 


a k = — J — \t\e Jk( ° 1 ' dt 
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The spectrum of the triangular wave is real and even (because the signal is 
real and even), so we can use a single plot to represent it as in Figure 4.25. 
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FIGURE 4.25 Line spectrum of output voltage, case A = 1. 
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is the Fourier series expansion of the full-wave rectified voltage. 

(d) What is the average power of the input voltage v. n (t) at frequencies higher 
than or equal to its fundamental frequency? Answer the same question for 
the output voltage v(t). Discuss the difference in power. 


Answer. 

Since a 0 = 0 , and given the Parseval theorem, the average power of the input volt- 
age v.„(t) at frequencies higher than or equal to its fundamental frequency is equal 
to its total average power computed in the time domain: 


+oo , 772 
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The average power in all harmonic components of v(t) excluding the DC com- 
ponent (call it P out ) is computed as follows: 


„ V I |2 I I 2 1 f 2j I ,2 

P ou,= LKl “hi =W J dt -\ a o\ 

k=-° o 1 -772 1 

~~2> ~4~~12' 


Note that the input and output signals have the same total average power, but 
some of the power in the input voltage (namely A 2 / 4 ) was transferred over to DC 
by the nonlinear circuit. 

Exercise 4.2 

FS FS 

Given periodic signals with spectra x(t)<-^a k and y(t)<-^b k , show the following 
properties: FS ^ 

(a) Multiplication: x(t)y(t)<r^. Y a p k _j 
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Answer. 


x(t)y(t) = X a k e Jk%t X b n 


-jn(0 Q t 


k=- 


= X X a k b n 


-j(k+n)(OJ 


k=-°° n=- 


= X X a k b P -k e 


-jpco 0 t 


k =~ ~ p=-°° 

+00 A +00 


= X X «A 

p=^o\k =- o 






FS coeff. c 




Therefore, x(t)y{t)<^> X a i b k-r 

C re 

(b) Periodic convolution: x(x)y(t-x)dx<-^Ta k b k 

T 

Answer. 

^x(x)y(t-x)dx = J a k e jkC0 ° T ^ b p e Jpo>oU ^ r} dx 


j k=- 

+00 


P=~ 

+00 


= J X £ b p e~ jp0>,>T e ip0>l,t dz 

T k=-°° p =- 00 

= J X X a k b p e J<k ~ p)0> ” z dTe Jpc ’ v 

T k=^°p =-° o 

= X X a Aj< 

k=^°p=-oo T 

+00 

= X 

k=-oo 

C re 

Therefore, x( T)y(t -x)dx<r^ Ta k b k . 


e J(k-p)CO 0 T ^ e Jp(O 0 l 
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Exercise 4.3: Fourier Series of the Output of an LTI System 

Consider the familiar rectangular waveform x(t) in Figure 4.26 of period T and 
2/ • • • • • • 
duty cycle rj = - f . This signal is the input to an LTI system with impulse response 

h(t) = e~ 5t sin( 1 Qnt)u(t). 






X 

1 

■(t) 



■ 






1 

... 

-T ~t 0 

T 1 


FIGURE 4.26 Rectangular wave input to an LTI system. 


(a) Find the frequency response H(jco) of the LTI system. Give expressions 
for its magnitude \H( jco)\ and phase ZH(jco) as functions of ( 0 . 


Answer. 

The frequency response of the system is given by 


H(jco) 


- 1-00 

J e 51 sin( 1 ()nt)e ,c "' dt 

0 

— J (e il0M -e~ jl 0M )e H5+ja)t dt 

o 

1 400 


2 j 


2y(5 + j(co - 1 Ott)) 2j(5 + j(co + 1 0^)) 
(5 + j(co + 1 Ok)) - (5 + j(co - 1 Ok)) 

2j(5 + j(co - 1 07t))(5 + j(co + 1 Ok)) 

10 K 

25- co 2 + 100k 2 + jlOco 
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Magnitude: \H(jeo)\= , 

[(25 - co 2 + 1007r 2 ) 2 +100or] 1 

Phase: ZH(jco) = arctan { — - 1 

l 25 -co 2 + 100;r J 

(b) Find the Fourier series coefficients a k of the input voltage x(t) for T = Is 
and a 60% duty cycle. 


Answer. 

The period given corresponds to a signal frequency of 1 FIz, and the 60% duty 
cycle means that ij = [ , so that the spectral coefficients of the rectangular wave are 

given by a k = | sinc( f ) . 

(c) Compute the Fourier series coefficients b k of the output signal y(t) (for the 
input described in (b) above) and sketch its power spectrum. 


Answer. 


b k = H(jkco 0 )a k = jsinc(y) 
6^sinc(y) 


5 25 ~(kco 0 ) 2 +100tt 2 + j\0kco Q 


25-(k2n) 2 + mn 2 + j20nk 


The power spectrum of the output signal is given by the expression below and 
shown in Figure 4.27. 



FIGURE 4.27 Power spectrum of the output signal. 





FIGURE 4.28 Approximation of the output signal 
using a truncated 100-harmonic Fourier series. 
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Exercise 4.4: Digital Sine Wave Generator 

A programmable digital signal generator generates a sinusoidal waveform by fil- 
tering the staircase approximation to a sine wave shown in Figure 4.29. 



FIGURE 4.29 Staircase approximation to a sinusoidal wave in Exercise 4.4. 


(a) Find the Fourier series coefficients a k of the periodic signal x( t ). Show that 
the even harmonics vanish. Express x(t) as a Fourier series. 

Answer. 

First, the average over one period is 0, so a 0 = 0 . For k ^ 0 , 


T 



3 6 
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T T T 



Note that the coefficients are purely imaginary, which is consistent with our 
real, odd signal. The even spectral coefficients are for: 



Figure 4.30 shows a plot of x(t) computed using 250 harmonics in the MAT- 
LAB program Fourierseries.m, which can be found in the Chapter 4 folder on the 
onthcco companion CD-ROM. 

The Fourier series representation of x(t) is 

+°° 2/r +oo . , f / _ V ( _ \ 1 ,2* 

, , x -1 jk ^‘ X -1 M , K . 2k . / , \ J k ^F* 

x(t)= 2_! a k e = 2-i -cos k — +cos k — -I + cosIattI e 1 . 

*=- oo *•=-. o 27r ^'L v -U v 3 ) 

M 

(b) Write x(t) using the real form of the Fourier series. 

+°° 

x(t) = a 0 + 2 ^[B k cos (kco 0 t) - C k sin(A;<y 0 £)] 

k=i 
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1.5 
1 

0.5 
0 

- 0.5 
-1 
- 1.5 

-1 - 0.8 - 0.6 - 0.4 - 0.2 0 0.2 0.4 0.6 0.8 1 f 

FIGURE 4.30 Truncated Fourier series approximation to the staircase 
signal and first harmonic in Exercise 4.4(a). 



Recall that the C k coefficients are the imaginary parts of the a k s. Hence 


x(t) = X 


k= 1 


-A 

nk 


-cos 


1 n ^ 
k — 

\ 3 y 


+ COS 


r 2 k 3 
k — 

3 


-1 + COs(A'7t) 


sin(/rw ( /). 


(c) Design an ideal lowpass filter that will produce the perfect sinusoidal 
waveform y(t) = sin at its output, with x(t) as its input. Sketch its fre- 
quency response and specify its gain K and cutoff frequency 0 ), . 


Answer: 

The frequency response of the lowpass filter is shown in Figure 4.3 1. 


H lp {jco) 




k 

K 









-CO c C0 c CO 

FIGURE 4.31 Frequency response 
of the lowpass filter. 
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The cutoff should be between the fundamental and the second harmonic, for 
example, (Q c = y ■ The gain should be 


-n 


(n] 

i 


fltr) 

K = — 

-cos 


+ COS 


A 


v 3 J 

1 


1 3 ) 

-it 

1 

1 


-1 

K 


~2~ 

2~ 

Z 


3 A' 


(d) Now suppose that the first-order lowpass filter whose differential equation 
follows is used to filter x(t): 

at 

where the time constant is chosen to be x = — . Give the Fourier series representa- 

2k r 

tion of the output y(t). Compute the total average power in the fundamental com- 
ponents P hot and in the third harmonic components P yot . Find the value of the DC 
gain B such that the output w(t ) produced by the fundamental harmonic of the real 
Fourier series of x(t) has unit amplitude. 

Answer. 


H(s) = 


B 

TS + 1 

B 


H(ja>) = — , 
xjco + l 




B_JA 

h^oo jk + 1 
k* 0 



( n ^ 


f, 2n\ 

-cos 

k— 

+ COS 



l 3 ; 


l 3 J 


-1 + cos(Atz:) 


2 n 
ik — t 
o T 


Power: 


p =2 

hot 


= 2 


B jA 


j + 1 2 7T 

B J2A 
j 1 27T 


-cos 


v3y 


+ COS 


f 2 

V 3 J 


•1 + cos^) 


= A l B 


2 d 2 9 


4 jt 


|2 
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P =2 

Hot 


= 2 


[-cos(tt)+ cos(27r)-l + cos(37r)J 

B jA 


y’3+ 


r- 2 i 

\2n l j 


= 2 


4 A 2 B 2 A 2 B 2 


40tT 


5tT 


For the filter’s DC gain B, we found that the gain at co 0 should be 

B B 


K 


— = H(jCO 0 ) =r~ 


3 A 


o£ = 


i ^'® 0 + 1 | 
n^j(zco 0 f + 1 


(tcu 0 ) 2 + 1 


3 A 


Exercises 

Exercise 4.5 

The output voltage of a half-wave rectifier is given by v(?) = j J ’ *' '"^<0 • 

Suppose that the periodic input voltage signal is v jn ( t ) = A sinfco^), a> 1 = In I T x . 
Find the fundamental period T and the fundamental frequency co 0 of the half-wave 
rectified voltage signal v(t). Compute the Fourier series coefficients of v(t) and 
write the voltage as a Fourier series. 


Answer: 



ON THE CD 


Exercise 4.6 

Suppose that the voltages in the full-wave bridge rectifier circuit of Figure 4.21 are 
v. n (t) = 4sin(m o t), co 0 = 2 n/T , and v(t) = |v. n (f)| • Let T x = T/l be the fundamen- 
tal period of the rectified voltage signal v(t) and let 0 ) ] = 2njT x be its fundamental 
frequency. 

(a) Compute the Fourier series coefficients of v(t) and write v(t) as a Fourier 
series. 

(b) Express v(t) as a real Fourier series of the form v(t) = a n + 

-too 

2 £ [B k cos(A-m/) - C k sin(Cco 1 0] • 
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Exercise 4.7: Fourier Series of a Train of RF Pulses 

27T 

Consider the following signal x(t) of fundamental frequency (0 Q = — , a periodic 
train of radio frequency (RF) pulses. Over one period from -T / 2 to T/l, the sig- 
nal is given by 


Acos(cot), -T x <t <T { 


x(t) = \ 


0 , 

0 , 


-T/2 <t < —T x . 
T x <t< T / 2 


This signal could be used to test a transmitter-receiver radio communication 
system. Assume that the pulse frequency is an integer multiple of the signal fre- 
quency; that is, 0 ) = Nco . Compute the Fourier series coefficients ofx(f). 


Answer. 



ON THE CD 


Exercise 4.8 

(a) Compute and sketch (magnitude and phase) the Fourier series coefficients 
of the sawtooth signal of Figure 4.32. 



FIGURE 4.32 Periodic sawtooth signal in Exercise 4.8(a). 


(b) Express x(t ) as its real Fourier series of the form 


x(t) = a 0 + 2^[B k cos(kco 0 t) - C, sinf kuy)]. 

k = 1 
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(c) Use MATLAB to plot, superimposed on the same figure, approximations 
to the signal over two periods by summing the first 5 and the first 50 har- 

N k —t 

monic components of x(t), that is, by plotting x(t)= ^\a k e T> . Discuss 
your results. 

(d) The sawtooth signal x(t) is the input to an LTI system with impulse re- 
sponse h{t) = e~' sin(2 nt)u(t) . Let y(t) denote the resulting periodic out- 
put. Find the frequency response H(jco) of the LTI system. Give 
expressions for its magnitude |//(y'co)| and phase ZH( jo)) as functions of 
co. Find the Fourier series coefficients h k of the outputy(t). Use your com- 
puter program of (c) to plot an approximation to the output signal over two 
periods by summing the first 50 harmonic components of y(t). Discuss 
your results. 

Exercise 4.9 

Consider the sawtooth signal y(t) in Figure 4.33. 



FIGURE 4.33 Periodic sawtooth signal in Exercise 4.9. 


(a) Compute the Fourier series coefficients of v(t) using a direct computation. 

(b) Compute the Fourier series coefficients of y(t) using properties of Fourier 
series, your result of Exercise 4.8(a) for x(t), and the fact that y(t) = 
x(t) -x(-t). 


Answer. 
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Exercise 4.10 

Compute and sketch (magnitude and phase) the Fourier series coefficients of the 
following signals: 

(a) Signal x(t) shown in Figure 4.34. 

(b) x(t) = sin( 1 Ott?) + cos(207T?) 



FIGURE 4.34 Periodic rectangular signal in Exercise 4.10(a). 




The Continuous-Time 
Fourier Transform 


In This Chapter 

■ Fourier Transform as the Limit of a Fourier Series 

■ Properties of the Fourier Transform 

■ Examples of Fourier Transforms 

■ The Inverse Fourier Transform 

■ Duality 

■ Convergence of the Fourier Transform 

■ The Convolution Property in the Analysis of LTI Systems 

■ Fourier Transforms of Periodic Signals 

■ Filtering 

■ Summary 

■ To Probe Further 

■ Exercises 


((Lecture 15: Definition and Properties of the Continuous-Time Fourier Transform)) 

T he Fourier series is a frequency-domain representation of a continuous-time 
periodic signal. What about aperiodic signals? The concept of Fourier series 
can be extended to the Fourier transform, which applies to many aperiodic 
signals. For instance, all signals of finite energy have a Fourier transform, also 
called a spectrum. 

As mentioned earlier, engineers often like to think of a signal as a spectrum 
whose energy is mostly contained in certain frequency bands. For instance, the 
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Fourier transform of a human voice signal would show that most of the spectral 
contents of the signal are contained between 300 FIz and 3400 FIz. This is why the 
old telephone lines, seen here as linear time- invariant (LTI) systems that transmit 
continuous-time voice signals as voltage signals, were designed to have a flat fre- 
quency response over that band so as to maintain signal integrity. 


FOURIER TRANSFORM AS THE LIMIT OF A FOURIER SERIES 


In order to introduce the Fourier transform, we will use the specific example of a 
periodic rectangular signal, and we will let the period tend to infinity so as to have 
only the base period effectively remaining, that is, the part of the waveform around 
time t = 0. We will see that the Fourier transform in this particular case is nothing 
but the sine envelope of the Fourier series coefficients. 

Consider the Fourier series representation of the rectangular wave x(t) shown 
in Figure 5.1. 


* r(t) 






i. 

1 

* V } 



■ 






1 

... 

-T ~t„ 

C T t 


FIGURE 5.1 Periodic rectangular waveform. 


Suppose we normalize the spectral coefficients of x(t) by multiplying them by 
T, and we assume that t 0 is fixed, so that the duty cycle i] = will decrease with 
an increase in T: 


Ta, 

k 


f 

T rjsinc {kv^j = 2t 0 sinc 

V 


*31 

T 


(5.1) 


Then, the normalized coefficients Ta k of the rectangular wave have a sine en- 
velope with a constant amplitude at the origin equal to 2 1 0 and a zero crossing at the 
fixed frequency j rad/s, both independent of the value of T. This is illustrated in 
Figure 5.2 with a°50% duty cycle and in Figure 5.3 for a 12.5% duty cycle; that 
is, the fundamental period T in Figure 5.3 is four times as long as T in Figure 5.2. 




The Continuous-Time Fourier Transform 1 77 



FIGURE 5.2 Sine envelope of the spectral coefficients of a rectangular 
wave with a 50% duty cycle. 



FIGURE 5.3 Sine envelope of the spectral coefficients of a rectangular 
wave with a 1 2.5% duty cycle. 


We see that as the fundamental period increases, we get more and more lines 
packed in the lobes of the sine envelope. These normalized spectral coefficients turn 
out to be samples of the continuous sine function in the line spectrum of x( t ) . Also, 
note that the two above spectra are plotted against the frequency variable kco 0 with 
units of rad/s, rather than the index of each harmonic component. We can see that 
the first zeros on each side of the main lobe are at frequencies oo = ±- rad/s and these 
frequencies are invariant with respect to the period T. They only depend on the 
width of the pulse. 

Thus, our intuition tells us the following: 
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■ An aperiodic signal of finite support that has been made periodic by “repeat- 
ing its graph” every T seconds will have a line spectrum that becomes more 
and more dense as the fundamental period T is made longer and longer, but the 
line spectrum has the same continuous envelope. 

■ As T goes to infinity, the line spectrum will become a continuous function of 
frequency co: the envelope. 

It turns out that this intuition is right, and the resulting continuous function of 
frequency is the Fourier transform. Recall that the Fourier series coefficients for the 
rectangular wave were computed using the formula 

V 2 

a k =— J x(t)e Jkl “"' dt, (5.2) 

T — V 2 

2tt ~ 

where co Q = — as usual. Now define a signal x(t) equal to x( t) over one period 
and zero elsewhere, as shown in Figure 5.4. 


X(Y) 




1 






-fr 

L t 


FIGURE 5.4 An aperiodic rectangular pulse signal corresponding 
to one period of x(t). 


This aperiodic signal, a single rectangular pulse, can be thought of as being pe- 
riodic with an infinite fundamental period (we will let T — > +°° later). Since 
x{t) = x(t) over t e [—T/2,T/2^, the spectral coefficients a k of the periodic sig- 
nal x(t) can be written in terms of the aperiodic signal x(t) as follows: 

a k = ~ J x(t)e jkc ° 0> dt. (5.3) 

Let us define the envelope X(jco) of Ta k (we already know that it is the sine 
function): 



The Continuous-Time Fourier Transform 1 79 


t n 

sinc(— CO). (5.4) 

n 

The coefficients a k are therefore samples of the continuous envelope X(jco): 

a k = ^X(jkco 0 ). (5.5) 

Now, the periodic signal x(t) has the Fourier series representation 

*(0 = X f x (J kco 0 )e Jk% ‘- 

k=-oo 1 

2k 

Or, equivalently, since O) 0 = — , 

1 + 00 

x(t) = — X x (jkco 0 )e jk(O °'co 0 . 

2ft 

At the limit, as T — > +°° in Equation 5.7, we get 

■ G)q ^ dco (The fundamental frequency becomes infinitesimally small.) 

■ ka> 0 — > co (Flarmonic frequencies get so close together that they become a 
continuum.) 

■ The summation tends to an integral. 

■ x(t) — > x(t) (The periodic signal tends to the aperiodic signal.) 

All of these elements put together give us an expression for the aperiodic sig- 
nal in terms of its Fourier transform: 


(5.6) 


(5.7) 


+oo +^0 

X(jco) := J x(t)e~ jcm dt = J e~ jl0 ‘ dt = 2 t Q 


j Too 

Inverse Fourier Transform: x(t) = — J X( jo))e JO "do) . (5.8) 

Let us rewrite Equation 5.4 for an arbitrary x{t) here for convenience: 

+oo 

Fourier Transform: X(jco) = J x(t)e~ Jcol dt (5.9) 

These two equations are called the Fourier transform pair. Equation 5.9 gives 
the Fourier transform or the spectrum of signal x(t), while Equation 5.8 is the in- 
verse Fourier transform equation. Thus, the Fourier transform of the rectangular 
pulse signal of Figure 5.4 is X(jco) = 2t 0 smc(fco), as obtained in Equation 5.4. 
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PROPERTIES OF THE FOURIER TRANSFORM 


We denote the relationship between a signal and its Fourier transform as 

FT 

x(t)<r^X(jco). Try to derive the following properties of the Fourier transform by 
using Equation 5.8 and Equation 5.9 as an exercise. Note that these properties are 
summarized in Table D.2 of Appendix D. 

Linearity 

The Fourier transform is a linear operation: 

FT 

ax(t) + by(t)<r^aX(jco)+bY(jco), a,b&C. (5.10) 

Time Shifting 

A time shift results in a phase shift in the Fourier transform: 

FT 

x(t-t Q )<r^e JC0t °X(jco). (5.11) 


Time/Frequency Scaling 

Scaling the time variable with ael either expands or contracts the Fourier trans- 
form: 


FT 1 

x(at)<r^7— ,X(j(o/a). (5.12) 

r 

For a > 1, the signal x(at) is sped up ( or compressed in time), so intuitively its 
frequency contents should extend to higher frequencies. This is exactly what hap- 
pens: the spectrum (Fourier transform) of the signal expands to higher frequencies. 
On the other hand, when the signal is slowed down (a < 1), the Fourier transform 
gets compressed to lower frequencies. 

Conjugation and Conjugate Symmetry 

In general, the signal is complex, so we can take its conjugate and we obtain 

* FT 

x (t)<->X (-jco). (5.13) 

In particular, if the signal is real, that is, x*(t) = x(t), then the Fourier trans- 
form has conjugate symmetry X*( jco ) = X(-jco) . Other interesting consequences 
include 
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■ Rc { X ( jco ) } = \lc{X(~jco)\, an even function of co 

■ Im {X( jco)} = -Im {X(-jco)}, an odd function of CO 

■ | X(jco) |=| X(-jco)\, an even function of co 

■ XX (jco) = -XX (-jco), an odd function of co 

Furthermore, if x(t) is real and even, then we can show that 

■ X(jco) = X(- jco) = X*(jco), that is, the spectrum is even and real. 

Similarly, if x(t) is real and odd, we have 

■ X(jco) = -X(-jco) = -X*(jco), that is, the spectrum is odd and purely 
imaginary. 

Differentiation 

Differentiating a signal results in a multiplication of the Fourier transform by joy. 

4: x(t)<^ jcoX(jco ). (5J4) 

at 


Integration 

Integration of a signal results in a division of the Fourier transform by jco. How- 
ever, to account for the possibility that x(t) has a nonzero, but finite, average value, 

+oo 

that is, X(jO) = X(0) = J x(t)dt & 0 , we must add the term nX(0)S(co) to the 

Fourier transform. That is, upon integrating x(t), the nonzero average value of x(t) 
produces a constant part with finite power concentrated at DC (co = 0), and this is 
represented as an impulse at that frequency. 

r ft l 

x(z)dz<r — X(jco) + kX(0)S(co). (5.15) 

i J m 


Convolution 

The convolution of two signals results in the multiplication of their Fourier trans- 
forms in the frequency domain: 

FT 

x(t)*y(t)<->X (jco)Y (jco). (5.16) 

A direct application of this property is the calculation of the response of an LTI 
system with impulse response h(t) to an arbitrary input signal x(t), which is given 
by the convolution y(t) = x(t) * h(t) . The Fourier transform of the output Y(jco) is 
obtained by multiplying the Fourier transform of the input signal X(jco) with the 
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frequency response of the system H( jco) (the Fourier transform of its impulse re- 
sponse). The output signal in the time domain is obtained by taking the inverse 
Fourier transform of its spectrum. 

Multiplication 

The multiplication property is the dual of the convolution property. The multipli- 
cation of two signals results in the convolution of their spectra: 

FT 1 

x{t)y{t)^—X(j(o)*Y{jm). (5.17) 

in 

Amplitude modulation is based on this property. For example, consider the 
modulation system described by 


y(t) = cos(CD 0 t)x(t), (5.18) 

where the signal x(t) is modulated by multiplying it with a sinusoidal wave of fre- 
quency (O 0 . We will see later that the Fourier transform of the carrier 
c(t ) := cos (coj) is composed of two impulses of area 7t, one at -co 0 and the other at 
(O 0 , as shown on the right in Figure 5.5. Suppose that the spectrum of x(t) has a tri- 
angular shape as shown on the left in Figure 5.5. 


/ 

. X(jco) 

\ . _J 

r 

. C(jco) 

i 

l 

-co x 

w 

(0{ CO ~ CO 0 

®o co 


FIGURE 5.5 Spectra of the signal and the carrier. 


Recall that the convolution of a function with an impulse simply shifts the 
function to the location of the impulse. For a time-domain signal, this amounts to 
a time shift, and for a Fourier transform, it amounts to a frequency shift. Thus, the 
Fourier transform of the resulting amplitude modulated signal y(t) is as shown in 
Figure 5.6. 

Multiplication of a signal by a sinusoid shifts its spectrum to another frequency 
band (it also creates a mirror image at the negative frequencies) for easier trans- 
mission over a co mm unication channel. For example, music (bandwidth less than 
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Y(jco) = - 1 - C (ji y) * A' (,/&>) 

2 K 



FIGURE 5.6 Spectrum of an amplitude modulated signal. 


20 kHz) transmitted over typical AM radio has modulation frequencies in the range 
of 500 kHz to 1500 kHz. Modulated signals in this range can be conveniently 
transmitted at reasonable power by using “reasonable size” antennas (actually they 
seem large by today’s standards!). The basic theory of modulation is presented in 
Chapter 16. 


Energy-Density Spectrum 

Recall that the power spectrum of a periodic signal is defined as the squared mag- 
nitudes of its Fourier series coefficients. A plot of the power spectrum of a signal 
gives us an idea of the density of power at different frequencies (harmonics). 

Similarly, the energy-density spectrum of an aperiodic signal is defined as 

i i 2 

the magnitude squared of its spectrum; that is, \X(jco)\ is the energy-density spec- 
trum of x{t). We can find the energy of a signal in a given frequency band by inte- 
grating its energy-density spectrum over the interval of frequencies. 

For example, 


1 b 


(5.19) 


Note that for real signals, it is customary to include the negative frequency 
band as well. For example, if we wanted to compute the energy contained in a real 
signal between, for example, 5 kHz and 1 0 kHz, we would compute 


[100007r.20000.ir] 


^ 20000tt ^ -100007T i 20000 ;r 

— [ \x(jco)\ d a + [ \X(jco)\ 2 dco =— f \X(jco')\ 2 dco (5.20) 

J 1 1 J 1 1 jt J 1 



184 Fundamentals of Signals and Systems 


Parseval Equality 

Just like the total average power of a periodic signal is equal to the sum of the pow- 
ers of all its harmonics, the total energy in an aperiodic signal is equal to the total 
energy in its spectrum. This is the Parseval equality for Fourier transforms: 


J |x(t)| dt 


2 n 


J \X(jco)\ dco. 


(5.21) 



((Lecture 16: Examples of Fourier Transforms, Inverse Fourier Transform)) 


EXAMPLES OF FOURIER TRANSFORMS 


Let us compute the Fourier transforms of a few signals. 

Fourier Transform of the Complex Exponential Signal 

The Fourier transform of e~ at u(t), a = a + jfi e C, a > 0 is computed as follows: 


X(jco) = J e- a 'u(t)e- jw dt 


converges for a > 0 


= J = J e (a+lp+J(0)t dt = J e- at e- jXP+a,), dt 


1 


jC0+ a 


1 


j{co + /3) + a 


Re{a} > 0 


a > 0 


(5.22) 


Figure 5.7 shows a plot of the magnitude and phase of X{j(d) for the important 
case a > 0 real (a = a). Call it Xfjco). 


Remarks: 


■ For the case where x(t) is the impulse response h(t) of a first-order differential 
LTI system: 

• The system is a lowpass filter with DC gain of 1 la. 

• Fligh frequencies in the input signal are attenuated. 
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• The cutoff frequency of the filter is (O c = a , where frequency components of 
the input signal are attenuated by a factor 1 /V 2 . 

• The maximum phase added to the input signal is -n/2 for 0 ) —> +°° . 

In the case of a = a + j/5, a > 0, (3 ^ 0 , the Fourier transform of the complex 
exponential Xfjco ) can be obtained by shifting the magnitude and phase of 
Xfjco): 


X 2 (jco) = Xfj(co + P)) = 


1 

j(co + p) + a 


(5.23) 



FIGURE 5.7 Fourier transform of a real exponential signal. 


Note that this is a shift to the left in the frequency domain when f > 0 , so in 
this case the magnitude and phase of X 2 {jco) would look like the ones plotted in 
Figure 5.8. 
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FIGURE 5.8 Fourier transform of a complex exponential signal. 


Suppose we want to calculate the Fourier transform of the damped sinusoid 
= = e~ a ‘ sm(co Q t) . By the linearity and conjugation properties 

and by using our result for a complex exponential signal, we can write 


xJt) = e “ r sin(co t)u(t) = —\e {a /<u ° ] 'u(t) - e (a+J<0 ° )r u(t) 


2/ L 


FT 


^{j(o) = Y, 

~V 


1 


1 


j((o-co 0 ) + a j(co + co 0 ) + a 

j(co + co Q ) + a- [j(co - co 0 ) + a] 
[J(co - co ,. ) + a][y(cn + cm ) + a] 


(O n 


(jco + a ) 2 + co 2 


(5.24) 


Flere, the damped sinusoid signal is real, so we should get an even | X 3 (jco) \ 
and an odd ZX 3 (jco ) . This turns out to be the case as shown in Figure 5.9. If we 
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assume that co 0 > a, it can be shown that the magnitude peaks to / a at the fre- 
quencies co = ± yja^-a 2 . The phase tends to -n as 0) — > +°° , and it is equal to -Till 
and Till at the frequencies co = V® 0 2 +a 2 and co = - aK 2+ “ 2 , respectively. 



FIGURE 5.9 Fourier transform of a damped sinusoid. 


Fourier Transform of an Aperiodic Sawtooth Signal 

Let us calculate the Fourier transform of the aperiodic sawtooth signal x(t) shown 
in Figure 5.10. 



FIGURE 5.10 Aperiodic sawtooth signal. 
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X(joJ) = J x(t)e~ jm dt 

o r, 

= J (-Tj - t)e ,m dt + J (7) - t)e ,M dt 

-T x 0 

T T 

1 \ A i 

: j*— JC °( T T ^dz + J (T { — z)e yWT dz (r = t + r in first integral, t = t in second integral) 


o 


= J~ Te 
0 

T T 

= T X \ e~ jm dz - (e j0)Tl + 1) j ze~ jm dz 


o 


0 




-jco 


-jco 


-/ft> -jco 


\. t(fia, x ~i e ~ jmdT 




= — s-Cg-^-i)- 
— jco 


JCO 

Tje~’ mT ' + 1) 


-7® 


-(./«) 


27) (, e je,T '-e m ') 

jco {jco) 2 
2T ] 2 j sin(G)7’ 1 ) 

jco (jco) 2 

( 


= J 


2sin(ror i ) 2Jj 


or 


(5.25) 


This Fourier transform is purely imaginary and odd, as we would expect since 
the signal is real and odd. Hence, this Fourier transform is equal to zero at co = 0; 
that is, the signal’s average value is zero (apply L’Hopital’s rule twice). 


THE INVERSE FOURIER TRANSFORM 


In general, one would have to use the integral of Equation 5.8 to obtain the time- 
domain representation of a signal from its Fourier transform. 


Example 5.1: Consider the ideal lowpass filter with cutoff frequency co c and 

given by its spectrum H(jco) = J L < ( ° c . The corresponding impulse response is 
calculated as follows. I 0 ’ M-®* 
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h(t) = — f H(jco)e jc °‘dco = — [ e Ja, dco 

2 K J Ow J 


2 n 


= — !— |>T = 

2 n(jt ) L 


sin(<y t) co 


. co 

sm(—tn) 

K 


nt 


n co nt 


n 


CO 

= — L sinc 
n 


( co ' 
—t 
n 


(5.26) 


Thus, the impulse response of an ideal lowpass filter is a real-valued sine func- 
tion extending from t = — °° to t = , as shown in Figure 5.11. 



FIGURE 5.1 1 Impulse response of a perfect lowpass filter. 


Very often, the Fourier transform will be in the form of a rational function of 
jco (a ratio of two polynomials in j co). In this case, it is much easier to perform a 
partial fraction expansion of the Fourier transform and then to identify each term 
in this expansion using a table of Fourier transforms and their corresponding time- 
domain signals. This method is usually preferred to obtain the output response of 
a stable differential LTI system using the convolution property. 

Example 5.2: Consider the response of an LTI system with impulse response 

h(t) = e~ 2 ‘u(t), (which meets the Dirichlet conditions) to the input x(t) = e~ 3 'u(t) . 
Rather than computing their convolution, we will find the response by multiplying 
the Fourier transforms of the input and the impulse response. From Equation 5.22, 
we have 


X(jco) = 


_L 

jco + 3’ 


H(jco) = 


1 

jco + 2' 


(5.27) 
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Then, 


Y(jco) = X(jco)H(jco) = 


1 

O'® + 3)0'® + 2)' 


(5.28) 


The partial fraction expansion consists of expressing this transform as a sum of 
simple first-order terms. 


Y(jco) = 


A B 

1 

jco + 2 jco + 3 


(5.29) 


The constants A, B can be determined by substituting values for the frequency 
CO (e.g., 0) and solving the resulting system of linear equations. An easier technique 
consists of applying the following procedure. 

1. Equate the right-hand sides of Equations 5.28 and 5.29 and let s := jco . 

1 A B 

= + (5 30) 

0 + 2)(s + 3) 5 + 2 5 + 3 V ; 

2. To obtain A, multiply both sides of the equation by (5 + 2) and evaluate for 
5 = -2. 


5 + 3 


= A + 


ls=-2 


(5 + 2)1 

(S + 3 ) 


\ s=-2 


A = 


1 


- = 1 


-2 + 3 

Applying Step 2 for the constant B , we obtain 


(5.31) 


1 


5 + 2 


( 5 + 3) A 


5 + 2 


+ B 


B = 


-3 + 2 


= -l 


(5.32) 


3. Finally, the partial fraction expansion of the Fourier transform of the out- 
put is given by 


Y(jco) = 


1 

jco + 2 


1 

jco + 3 


(5.33) 
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Using Table D. 1 of basic Fourier transform pairs in Appendix D, we find that 

y(t ) = e~ 2 'u(t ) - e~ 3, u(t). (5.34) 

For the case where the two exponents are equal, for example, h(t) = e~ 2 'u{ t) 
and x(t) = e~ 2, u(t), the partial fraction expansion of Equation 5.33 is not valid. On 

the other hand, in this case the spectrum of y(t) is given by Y( jco) = . 1 2 , which 

\J(0 + 2) 

in the table corresponds to the signal y(t) = te~ 2 'u(t ) . The partial fraction expan- 
sion technique will be reviewed in more detail in Chapter 6. 


DUALITY 


The Fourier transform pair is quite symmetric. This results in a duality between the 
time domain and the frequency domain. For example, Figure 5.12 shows that a rec- 
tangular pulse signal in the time domain has a Fourier transform that takes the form 
of a sine function of frequency. The dual of this situation is a rectangular spectrum 
that turns out to be the Fourier transform of a signal that is a sine function of time. 




xyjco) 


1 


-W W 


0) 


FIGURE 5.12 Duality between time-domain and frequency-domain functions. 

When such a rectangular spectrum centered at co = 0 is the frequency response 
of an LTI system, it is often referred to as an ideal lowpass filter because it lets the 
low frequency components pass undistorted while the high frequencies are com- 
pletely cut off. The problem is that the impulse response of this LTI system, the 
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time-domain sine function, is noncausal. Filter design will be discussed in more de- 
tail later on. 



((Lecture 17: Convergence of the Fourier Transform, Convolution Property and 
LTI Systems)) 


CONVERGENCE OF THE FOURIER TRANSFORM 


There are two important classes of signals for which the Fourier transform converges: 

1. Signals of finite total energy, that is, signals for which J |x(?)| dt<+°° 

2. Signals that satisfy the Dirichlet conditions: 

a. x(t) is absolutely integrable, that is, J |x(t)|c/? < +°° . 

b. x(t) has a finite number of maxima and minima over any finite interval 
of time. 

c. x(t) has a finite number of discontinuities over any finite interval of 
time. Furthermore, each one of these discontinuities must be finite. 

The type of convergence that we get for signals of finite energy is similar to 
the convergence of Fourier series for signals of finite power. That is, there is no 
energy in the error between a signal x(t) and its inverse Fourier transform 

x(t) = — f + X{ /( 0 )e J "" do) . For signals x(t) satisfying the Dirichlet conditions, it 

is guaranteed that x(t) is equal to x(t) at every time t, except at discontinuities 
where x(t) will take on the average of the values on either side of the discontinuity. 

Later, we will extend the Fourier transform to include periodic signals (infinite en- 
ergy, finite power) by allowing the use of impulse functions in the frequency domain. 


THE CONVOLUTION PROPERTY IN THE ANALYSIS 
OF LTI SYSTEMS 


General LTI Systems 

We have seen that the response of a stable LTI system to a complex exponential 
of the type e Ja " is simply the same exponential multiplied by the frequency re- 
sponse of the system H( jco)e jm ‘ . We used this fact to find the Fourier series co- 
efficients of the output of an LTI system as the product h f = H(jkco 0 )a k for a 
periodic input of frequency (O 0 with spectral coefficients a k . 
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In Example 5.2, we computed the output signal of an LTI system by using the 
convolution property of the Fourier transform. That is, even though the output ji’(t) 
of a stable LTI system with impulse response h(t) and subjected to an input x(t) is 

f +o° 

given by the convolution y(t)= x(j)h(t - z)dz , we can also compute it by 
taking the inverse Fourier transform of Y(jco) = H(jco)X(jco) . This is repre- 
sented in the block diagram of Figure 5.13. 


X(jco) 


► 


H(jco) 


Y(ja) 

► 


FIGURE 5.13 Block diagram of an LTI 
system in the frequency domain. 


For a cascade of two stable LTI systems with impulse responses h^t), h 2 {t), we 
have 


Y(jco) = H 2 (jco) H ] (jco) X(jco). (5.35) 

This is illustrated in Figure 5.14. 



FIGURE 5.14 Cascade interconnection of two LTI systems 
in the frequency domain. 

For a parallel interconnection of two stable LTI systems with impulse re- 
sponses h x (t), h 2 {t), we have 

Y{j(o) = [H^jco) + H 2 (jco)]X(jco). (5.36) 

This parallel interconnection is shown in Figure 5.15. 

For a feedback interconnection of two stable LTI systems with impulse re- 
sponses h x (t), h 2 (t), we have 


Y(jco) = 


\ + H y {jco)H 2 {jco) 


X{j(0). 


(5.37) 
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FIGURE 5.15 Parallel interconnection of two LTI 
systems in the frequency domain. 


Thi s feedback interconnection is shown in Figure 5.16. 



FIGURE 5.16 Feedback interconnection of two LTI 
systems in the frequency domain. 


LTI Differential Systems 

We already know how to solve for the response of an LTI differential system, 
which, in general, is given by the sum of a forced response and a natural response. 
Flowever, it is often easier to use a Fourier transform approach, provided the sys- 
tem is known to be stable. 

Consider the stable LTI system defined by an /V'^-ordcr linear constant- 
coefficient causal differential equation initially at rest: 

^ d k y(t) ^ , d k x(t) 

k = 0 Wf k = 0 wf 


(5.38) 
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Assume that X(jco), Y(jco) denote the Fourier transforms of the input x(t) 
and the output y(t), respectively. Recall that differentiation in the time domain is 
equivalent to a multiplication of the Fourier transform by jco. Thus, if we take the 
Fourier transform of both sides of Equation 5.38, we get 


X a k (jco) k Y(jco ) = X b k (jco) k X(jco ). 


(5.39) 


k = 0 


k = 0 


Since H(jco) = , the frequency response of the system is given by 


H(jco) = 


YbAjcof 

Y(jco) _ fl, kU 


X(jco) k 


(5.40) 


k = 0 


Example 5.3 The frequency response of the causal second-order LTI differential 
system, 


d 2 y(t) | 3 dy(t) 
dt 2 dt 


+ 2y(0 = 


dx(t ) 
dt 


x(t). 


(5.41) 


is calculated as follows: 

[(./«) 2 + 3 jco + 2]Y( /o)) = ( jco - l)X(jco) 
Y (jco) jco - 1 


H(jco) = 


X(jco) (jco) 2 + 3 jco + 2 


(5.42) 

(5.43) 


Note that the order of the system is the highest power of jco in the denomina- 
tor of the frequency response. Now, suppose we want to obtain the system’s re- 
sponse when the input signal is a unit step function. From Table D.l, The Fourier 
transform of the step function has the form 


so that 


X(jco) = — + 7 zS(co), 
jco 


(5.44) 
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Y(ja>) = , . 1 XUa>) 

0 ®) + 3jco + 2 

_/®-i r 1 x 

+ n8(co ) 

{jco) + 3 jco + 2 [ jco 

jco -l 1 , 

f =j ttc>(co) 

[{jm) 1 + 3 jco + 2 J jco ,2 / , 

sampling property 


(5.45) 


Letting s = jco and expanding the rational function on the right-hand side into 
partial fractions, we get 


s — 1 s - 1 ABC 

r =j — — — 1 1 ■ 

|j> 2 +3s + 2js (s + 1)(5 + 2)s s 5 + 1 5 + 2 


(5.46) 


and the coefficients are computed as follows: 


(5 + 1)(5 + 2) s=o 2 


(5.47) 


= — = 2 


s ( 5 + 2 ) U _ 1 -1 


(5.48) 


5(5 + 1) 


(5.49) 


Hence, 


Y(jco) = j= — — - — -n8{co) 

\ijcof + 3jco + l\jco 2 

if 1 f 1 'j 3( 1 

2 [jco J [jco + lj 2\jco + 2 


(5.50) 


and using Table D.l of Fourier transform pairs, we find the output by inspection: 


y( 0= -^ + 2e“'-^e 2 ' m(0- 


(5.51) 
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Remark: When M>N in differential Equation 5.38, the frequency response 

has a numerator of equal or higher order than the denominator polynomial. It is 
then necessary to express the frequency response as a sum of a strictly proper 
rational function (it means that the numerator polynomial is of lower order than the 
denominator) and a polynomial in jco of order M — N. Each term of this polyno- 
mial is associated either with an impulse (constant term), a doublet (term in jco), or 
a k th - order derivative of the impulse (term in ( joSf ). Then, one only needs to per- 
form a partial fraction expansion of the resulting strictly proper rational function to 
find the other time-domain components of the response. 

/ ((Lecture 18: LTI Systems, Fourier Transform of Periodic Signals)) 

Example 5.4: Consider the causal LTI differential system initially at rest de- 

scribed by 



(5.52) 


The frequency response of this system is 



(5.53) 


Let s =jco and write H(s) as 



(5.54) 


Multiplying both sides by 2(5 + 0.5), we can identify each coefficient: 

5 2 - 5 - 2 = 2(5 + 0.5)(Av + B) + 2C = 2^5 2 +(A + 2B)s + 2C+B (5.55) 



(5.56) 


Thus, 


5 2 — 5 — 2 _ 1 3 5 1 

2(5 + 0.5) ~ 2 S 4 8 (5 + 0.5) 


(5.57) 
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and 


1 3 


5 1 

8 O'© + 0.5) 


(5.58) 


Finally, the inverse Fourier transform of Equation 5.58 gives us the impulse 
response 


K t ) = ~ 8( [t ) - j S( t) - 1 e~ 05 ‘u(t). 
2 at 4 8 


(5.59) 


Example 5.5: Consider a stable causal second-order LTI differential system 

whose characteristic polynomial has complex zeros: 


d 2 y(t) dy(t) 
dt 2 dt 


+ y(t) = x(t) 


(5.60) 


The frequency response of this system is given by 

Y(jco) 1 1 


H(jco) = 


X(jco) (jcof + jca + l 1 .V3,. . 1 .V3, 


(5.61) 


Letting s =j(0 and expanding the right-hand side into partial fractions, we get 

1 1 


A B 

- + - 


s 2 +is+i i .Vi i . V3. 1 .V3 1 .Vi' 

s+ 2 +7 T S+ 2 _J T J+ 2 +y T 

The coefficients are computed as follows: 


(5.62) 


A = 


.Vi 


SH / 

2 2 


= 7 


Vi’ 


1 ,>/3 


(5.63) 


5 = 


.Vi 


5 + — + 7 
2 2 


Vi’ 


(5.64) 


1 , .71 
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Hence, 


H{j(0) = 


1 


i .73. . . i .73 . i Vi 7 73 . i .73 f5 65) 

(/GH 1 -7 )( 76L> H 7 ) 7GH h 7 7GH 7 v 3,03 ' 

\^/ 2 ** ^ ^ 2 17 2 ^ 2 ^ 2 ^ 2^2 


i 


i 


-j- 


i 


i 


and using Table D.l of Fourier transform pairs, we find the output by inspection: 


h(t) = 


i .-Ji ■ i 

7 — t-fwt 1 — t+j—t 

J—p 2 2 J_ p 2 2 


u(t ) 


2 4> 


= —i=e 2 Ref e 




^3 


■ u(t ) 


2 ,73 K. , . 

= —j=e 2 cos( — t )u(t ) 

V3 2 2' 

2 *4* • ,>/3 w v 

= -pe 2 sm( — f)w(f) 

V3 2 


(5.66) 


Remarks: 

■ For complex conjugate zeros of the characteristic polynomial, the two coeffi- 
cients of the first-order terms in the partial fraction expansion are also complex 
conjugates of each other. Therefore it is sufficient to compute only one, 
that is, A = j -j= in the above example, and then one can write directly 

* 1 

B = A = -j ~r . However, it is good practice to compute the second coefficient 
just to double-check that the calculation is correct. 

■ It is usually not sufficient to write the impulse response as a sum of two com- 
plex signals as in the first line of Equation 5.66. These signals are complex 
conjugates of each other, so that their sum can be simplified to get a real sig- 
nal at the end. More generally, if the differential system has real coefficients, 
the impulse response can always be expressed as a sum of real signals. 


FOURIER TRANSFORMS OF PERIODIC SIGNALS 


Periodic signals are neither finite-energy, nor do they meet the Dirichlet conditions. 
We will nonetheless use the Fourier transform to represent them by using singu- 
larity functions such as impulses in the frequency domain. We have already stud- 
ied the Fourier series representation of periodic signals with their spectra. We will 
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see that the Fourier transforms of these signals are the same spectra, but the coef- 
ficients (times 2n) now represent the impulse areas at the harmonic frequencies 
kco 0 . 

Let us consider a signal x(t) with Fourier transform that is a single impulse of 
area 2 tc at frequency kco 0 : 


X(jco) = 2nS(co- kco 0 ). (5.67) 

Taking the inverse Fourier transform of this impulse, we obtain by using the 
sampling property: 


x(t) = — [ 2 7rS((0 - kco )e JM d (0 
2 n J 


_ e i k <° o' 


(5.68) 


Thus, the frequency-domain impulse corresponds to a single complex har- 
monic component whose amplitude is one. Therefore, by linearity, a more general 
signal with Fourier transform, 

X(jco) = ^ 2na k S((0- k( 0 Q ), (5.69) 

k =- °o 


has the time-domain form 


x{t)= % a k e jka, "‘, (5.70) 

k=-oo 

which is the Fourier series representation of x(t). Therefore the Fourier transform 
of a periodic signal with Fourier series coefficients a k is a train of impulses of areas 
2na k occurring at the frequencies k(O 0 . 

Example 5.6: The Fourier transform of a sinusoidal signal of the form 

x(t) = Asir\{o) ( t) is X(jco) = jAnS{co + co 0 ) - jAnd{co -co 0 ). 

Fourier Transform of a Periodic Impulse Train 

Consider the impulse train signal shown in Figure 5.17, which can be written as 

+oo 

x(t) = ^ S(t-kT). 

k=-~° 


(5.71) 
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FIGURE 5.17 Impulse train signal. 


There are two ways to derive the Fourier transform of an impulse train. The 
first method is the one introduced above: use the Fourier series coefficients times 
2n as the areas of a periodic train of impulses in the frequency domain of frequency 
c 0 = 2 k/ T. We know that the spectral coefficients of the impulse train are 
a k = \/T ; hence, 

2n ^ 0 

X{j01) = —2 j 5( < m - kco o )• (5-72) 

1 k =- oo 

The second method consists of calculating the Fourier transform of the impulse 
train using the integral formula. This yields 

Too -J-OO 

X( jco) = J ^ 8(t - kT)e~ j,0 'dt 

_oo k=-oo 
+00 Too 

= ^ | 8{t - kT)e~ j0)l dt 

k=-oo _ 00 

+oo 

= ^7 e - J °> kT . (5.73) 

k=-° o 

This Fourier transform, shown in Figure 5. 1 8, is actually a periodic train of im- 
pulses of period co 0 = 2n/T (note that the period is a frequency) in the frequency 
domain. That is, the series in Equation 5.73 converges to the impulse train of Equa- 
tion 5.72. 
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FIGURE 5.18 Fourier transform of an impulse 
train signal. 



((Lecture 19: Filtering)) 


FILTERING 


In this section, we discuss an important application of the Fourier transform: fil- 
tering. Filtering is a rich topic often taught in graduate courses in electrical and 
computer engineering. We only give a rudimentary introduction to filtering to 
show how the frequency-domain viewpoint can help us understand the concept of 
shaping the spectrum of a signal by using filters. Sampling and modulation are also 
important applications of the Fourier transform. They will be studied in Chapters 
15 and 16, respectively. 

Frequency-Selective Filters 

Ideal frequency-selective filters are filters that let frequency components over a 
given frequency band (the passband) pass through undistorted, while components 
at other frequencies (the stopband) are completely cut off. A typical scenario 
shown in Figure 5.19, where filtering is needed, is when a noise n(t) is added to a 
signal x(t), but the noise has most, or all, of its energy at frequencies outside of the 
bandwidth of the signal. By linearity of the Fourier transform, the spectra of the 
signal and the noise are also summed together. We want to recover the original sig- 
nal from its noisy measurement x { (t). 

Here the noise spectrum is assumed to have all of its energy at higher frequen- 
cies than the bandwidth W of the signal. Thus, an ideal lowpass filter would per- 
fectly recover the signal, that is, x(t) = x(t ) , as seen in Figure 5.20. 
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n(t) 



filter 

FIGURE 5.19 Typical filtering problem. 




FIGURE 5.20 Effect of filtering in the frequency domain. 


Lowpass Filters 

An ideal lowpass filter cuts off frequencies higher than its cutoff frequency, C0 c . The 
frequency response of this filter, shown in Figure 5.21, is given by 



The impulse response h lp (t) of the ideal lowpass filter shown in Figure 5.22 
was found to be a sine function of time (it is even and real, as expected): 
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h J t ) = ' 


(0 


-sine 


n 


(0 


V 71 J 


(5.75) 


a ^( 7 ®) 


i 


-ra c ( o c 


► 

CO 


FIGURE 5.21 Frequency response 
of an ideal lowpass filter. 



FIGURE 5.22 Impulse response of an ideal lowpass filter. 


Recall that the convolution property of the Fourier transform is the basis for 

FT 

filtering: the output of an LTI system with impulse response h(t)<r^ H(jco) sub- 

FT FT 

jected to an input signal x(t)<r^X(jco) is given by y(t) = x(t)*h(t)<-^Y(jco) = 
H(jco)X(jco). 

Even though the above filter is termed “ideal” in reference to its frequency re- 
sponse, it may not be so desirable in the time domain for some applications because 
of the ripples in its impulse response. For example, the step response of the ideal 
lowpass filter is the running integral of the sine function shown in Figure 5.22. Its 
plot in Figure 5.23 indicates that there are potentially undesirable oscillations be- 
fore (because the impulse response is noncausal) and after the discontinuity. Such 
a signal in an electronic circuit might cause improper switching of a binary latch. 
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FIGURE 5.23 Step response of an ideal lowpass filter. 


As mentioned before, the impulse response of the ideal lowpass fdter is not re- 
alizable, as it is noncausal. Approximations to the ideal lowpass filter that can be 
realized by stable causal LTI differential equations have been proposed in the past, 
and some of them have found widespread use. One of these filters is the Butter- 
worth filter. The magnitude of the frequency response of an V'-ordcr Butterworth 
filter with cutoff frequency co c is given by 


Remarks: 

■ The DC gain is | H R {j())\ = 1. 

■ The attenuation at the cutoff frequency is | H B (j(D c ) | = for any order N. 

Figure 5.24 shows a plot of the filter’s magnitude for N = 2 (second-order) 
compared to the ideal “brick wall” magnitude. The transition band is the frequency 
band around (O c , where the magnitude rolls off. The higher the order of the Butter- 
worth filter, the narrower the transition band gets. 

The second-order Butterworth filter is defined by its characteristic polynomial: 

p(s) = (s- c oe ^ )(s - coe -^' 4 ) 

f i . i yir f i o 

— S — (O c ~j= + j 1= S — CO c T= — j —r= 

V v 2 v2yj[_ V V 2 \I2J_ 

= s 2 + (0 sfls + co 2 . 

c c 



( 5 . 77 ) 
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FIGURE 5.24 Magnitude of frequency response of 
a second-order Butterworth filter. 


Therefore the differential equation relating the input and output signals of this 
filter must have the form 


d 1 2 y(t ) 
dt 2 


+ CO , V2 + C 0 2 c y(t) = co 2 c x(t). 


(5.78) 


Note that it is necessary to add a gain of CO 2 , multiplying the input signal to ob- 
tain a DC gain of 1 for the filter. Recall that the DC gain is the gain of the filter 
when the input and output signals are constant, which means that the derivatives of 
y(t) are zero in Equation 5.78. 

Let us check that the frequency response of this differential equation has the 
magnitude of Equation 5.76. The frequency response of the second-order Butter- 
worth filter is obtained from Equation 5.78: 


HJjco) = 


Y(jco) 

X(jco) 


co" 


O '©) 2 + CO V2 jco + CO 2 
1 

1 1 ( J(» } 2 1 V27© 

CO CO 


1 (ftj )2 | V2 jco 

CO CO 


(5.79) 
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and the magnitude is 




CO 

C 

1 


+ - 


2co~ 


CO" 


l+(-) 4 

CO 


(5.80) 


The impulse response of a Butterworth filter is given by (following a partial 
fraction expansion of the frequency response): 


K(t) = i 2 , 


CO 


(0 e 


^ sin(^t)u(t). 
v 2 


(5.81) 


This impulse response does not oscillate much even though it is a damped si- 
nusoid. The decay rate is fast enough to damp out the oscillations. For example, if 
we plot the step response of this second-order Butterworth filter, we obtain the 
graph of Figure 5.25 with a single overshoot. 



FIGURE 5.25 Step response of a second-order 
Butterworth filter. 


Highpass Filters 

An ideal highpass filter cuts off the part of the input signal’s spectrum that is at 
lower frequencies than the filter’s cutoff frequency, co c . The frequency response of 
this filter, shown in Figure 5.26, is given by 


H hp Uco):= 


£0 < CO c 
co\ > CO 

I c 


(5.82) 
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FIGURE 5.26 Frequency response 
of an ideal highpass filter. 


Notice that the frequency response of an ideal highpass filter can be written as 
the difference between 1 and the frequency response of an ideal lowpass filter: 

H hp (jco) = \-H lp (jco). (5.83) 

The resulting impulse response is simply 

h hp ( t ) = 5 ( t )-h lp (t). (5.84) 

This suggests one possible, but naive, approach to obtaining a realizable high- 
pass filter. First, design a lowpass filter with cutoff frequency C 0 c and desirable 
characteristics in the transition band and the stopband. Second, form the frequency 
response of the highpass filter using Equation 5.83. 

Example 5.7: We can design a highpass filter using the second-order lowpass 

Butterworth filter of the above example. The resulting highpass magnitude of the 
frequency response of the filter is shown in Figure 5.27. 

H Bhp (jco) = \-H B (jco) 

1 

( jco ) 2 + 0) 42/0) + or 
(jco) 2 + co. jco + co 2 c - a>l 
(jco) 1 +o) 'Jljco + or 
(jco) 2 + co c 4ljco 
(jco) 2 + C0 C V2 jco + CO I 


(5.85) 



The Continuous-Time Fourier Transform 


209 



FIGURE 5.27 Magnitude of frequency response of a 
second-order highpass filter. 


The causal LTI differential system corresponding to this highpass filter is the 
following: 


d 2 y(t) 

dt 2 


+ C0 


^2 ^ll} + (0 2 y(t) = 

dt ' 


d 2 x(t) 

dt 2 


+ C0 


dx(t) 

dt 


(5.86) 


and the impulse response is as given by Equation 5.87: 


h Rh P ^ = ^(t) ~ 42(0 e £ sin (^t)u(t). 


(5.87) 


Bandpass Filters 

An ideal bandpass filter cuts off frequencies lower than its first cutoff frequency 
Q) cl and higher than its second cutoff frequency (O c2 , as shown in Figure 5.28. The 
frequency response of such a filter is given by 




1 , CO , < \co < (0 . 

I 7 cl | I c 2 

0, otherwise 


(5.88) 


The frequency response of an ideal bandpass filter can be written as the prod- 
uct of the frequency responses of overlapping ideal lowpass and highpass filters. 
The highpass filter should have a cutoff frequency of co cl and the lowpass filter co c2 . 


H bp (jco) = H hp (jco)H lp (j(o). 

This is one approach to designing bandpass filters. 


(5.89) 
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FIGURE 5.28 Frequency response of an 
ideal bandpass filter. 


SUMMARY 


In this chapter, we have extended the concept of Fourier series to aperiodic con- 
tinuous-time signals, which resulted in the Fourier transform. 

■ The Fourier transform was derived as the limit of the Fourier series of a periodic 
signal whose period tends to infinity. Classes of signals that have a Fourier 
transform include finite-energy signals and signals satisfying the Dirichlet 
conditions. 

■ The Fourier transform of a signal, also called a spectrum, is in most cases a 
complex-valued continuous function of frequency. Its magnitude and phase are 
usually plotted separately. The energy-density spectrum plot of a signal is the 
squared magnitude of its spectrum. 

■ The inverse Fourier transform is given by an integral formula. However, a par- 
tial fraction expansion of a Fourier transform can often be performed, and the 
time-domain signal is then obtained from a table of Fourier transform pairs. 

■ The Fourier transform of a periodic signal can be defined with frequency-do- 
main impulses located at the harmonic frequencies, whose areas are a constant 
times the Fourier series coefficients of the signal. 

■ In the frequency domain, signal filtering using an LTI system is simply the 
multiplication of the frequency response of the system with the spectrum of the 
input signal to either amplify or attenuate different frequencies. We briefly dis- 
cussed lowpass, bandpass, and highpass filters. 
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TO PROBE FURTHER 


For a more detailed treatment of the Fourier transform and its applications, see 
Bracewell, 2000. For a specialized treatment of filtering and filter design, see 
Schaumann and Van Valkenburg, 2001 and Winder, 2002. 


EXERCISES 

Exercises with Solutions 

Exercise 5.1 

Sketch the following signals and find their Fourier transforms. 

(a) x(t) = {\-e ^ j[w(t + 1) - u(t - 1)] . Show that X(jco) is real and even. 

Answer: 

The signal is sketched in Figure 5.29. 



Its Fourier transform is computed as follows: 


i 

X(jco) = J x(t)e~ jwr dt 






i u i 

= J e~ jm dt - J e°- J(0) ‘dt - J e~ (Ujm], dt 
-1 -1 0 

=— L|>«T Fp-«1° + T 

jCO L - 1-1 1 - 70) L - 1-1 1 + 10 ) L Jo 


1 - JO 


1 + ja> [ 
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e ia -e~ ,m \-e~'e ,a e x <f j(a - 1 

1 

jCO 1 - j CO 1 + JCO 

2 sin co | {\ + jco){-\ + e~ x e j<0 ) + {\-ja)){-\ + e~ l e~ j(0 ) 

co 1 + co 2 

2 sin co (-1 - jco + e~ l e JC0 + jcoe~'e J0> ) + (-1 + jco + e~ x e~ ](0 - jcoe~ x e ~ JCO ) 
co 1 + co 2 

2 sin co | -2 + e~ x (e j(0 + cT yft) ) + j(Oe~ l {e ja - e~ jco ) 
co 1 + co 2 

2 sin co -2 + 2e _1 (cos co -co sin co) 

co 1 + co 2 


This Fourier transform is obviously real. To show that it is even, we consider 
X{~jco ) : 


. 2sin( -co) -2 + 2e (cos(-co) + cosin(-co)) 
J - co 1 + (—co) 2 

-2 sin( co ) -2 + 2e 1 (cos(co) - co sin( co)) 


- + - 


-co 


1 + CO" 


= X(JCO). 


(b) Periodic signal x(t) in Figure 5.30. 





L 

1 

X(t) 



■ 

1 





| 

... 


-T 

-Ti 



Ti 

T 

► 

t 




-1 





FIGURE 5.30 Signal of Exercise 5.1 (b). 


Answer: 

This signal is the sum of the constant signal -1 with our familiar rectangular wave 

IT 

of amplitude 2 and duty cycle t? = -y . Therefore, its Fourier series coefficients are 
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2 T. 

a, =2 — L sinc 

K p 

AT. 

a n = 1 . 

(J p 


( k2T x ^ 


, k ^ 0 


Note that since 0 <T l <^, then -1 < a Q < 1 depending on the duty cycle. The 
Fourier transform of the signal is given by 


+oo ^p Jc2T 2 tt AT 

X(jco) = 2n^ -y-sincC - k — ) + 2 n(-X - 1)5(0)). 

k=-o° 

k*0 


Exercise 5.2 

Sketch the following signals and compute their Fourier transforms using the inte- 
gral formula. 


(a) x x (t) = \ 


2 n 2 k 
smffli, < t < — 


0 )„ 


0)„ 


o o 

otherwise 


Answer: 

This real, odd signal is composed of two periods of a sine wave. Its sketch is in Fig- 
ure 5.31. 


^(0 



FIGURE 5.31 Signal composed of two periods 
of a sine wave in Exercise 5.2(a). 


Let us compute its Fourier transform: 
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2 n 

®„ 


2k 

®„ 


X, 


j (jco) = J x(t)e JC0, dt = J sin(m () /)f j(0, dt 


2 K 

©n 


2k 

co n 


-i 

=± f 

2 j J 


2 K 

©n 


_ j(-a> 0 -<o)t 


dt 


2k 

©n 


j 


2 K 

®n ! j 

/(-<»o-©y 

2j(co 0 -co) 

£ 

~X 2./(-« 0 -«) 

£ 


2;r 

©o 

27T 

©o 


1 

p 0 _ 

-/(»<,-<»)— 
_ p ®o 

1 

-2(®o+®)— 

„ ®o _ 

;'(® 0 +®)— 

®o 

0 

3 

1 

3 

cT 

£ 

£ 

2((o 0 + <y) 

£ 

£ 


1 

. 27T 

-7© — 
(0 Q 

. 2k 

J(0 

CO o 

l 

. 2 K 
-jco — 
co 0 

2k 
jco — 

©0 

0 

3 

1 

3 

<N 

£ 

- £ 

2(co 0 + oo) 

£ 

- £ 


l 


. 2n . 2 k 

-jco — JO ) — 

2co 0 e % -2co 0 e 


2(co - co 0 ){co 0 + co) 

. . . ,2j t . 

2 /co„ sm( — co) 

% 

co 0 2 -co 2 


This Fourier transform is imaginary and odd, as expected, 
(b) x 2 ^ = x i (0*P(0, where xjt) is as defined in (a) and 

+°° 4^ 

p(t) = X S(t-k — ) is an impulse train. 


Answer: 

Note that x 2 (t) = xjt)* p(t) is just the regular sine wave of frequency co 0 since 

+oo Att +°° A — 

x 2 (t) = x l (t)* p(t) = xjt)* ^ 8(t-k — ) = ^ x l (t-k — ) = sin(cn 0 ?) . Thus, 

*=— 0) „ *=~ = 0) „ 


X 1 (jco) = J sin(co 0 t)e im dt 
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We know that the Fourier transform of e J<0 "' is given by 2 nS(co - co 0 ) , so 

X 2 (jco) = — —2nS(co + co 0 ) + —2 nS(co - co 0 ) 

2 j 

= jn 8 (co + co 0 )~ jn 8 (co-co 0 ) 

We can obtain the same result by applying the convolution property: 


Thus, 


X 2 (t) = *j(0 * p(t)^X l ( jCQ)P( jCQ) = X 2 (j(0). 


X 2 (jco) = X ] (jco)P(jco) = X x (j( 0 )^- £ 8 ( 0 ) -k°^) 

^ k=-°o ^ 

= T% X ' U 

. . . .In 0 ) 

2 ico. sin(k -) 

co. 0 cm 2 ' cm 

= j — ! 8 (oi- k^) 

2 k= ~° co 2 --k 2 co 2 2 

o 4 o 

_co () £ 2 jco 0 s\n(kn) 5 ^ a ^ co 0) 

2 2 1 i 2 „ 2 2 

cm — k co. 

o 4 o 


The term in the above summation for X 2 (jco) is equal to zero for all integers 
k & ±2. In the case of k = 2, we have a 0/0 indeterminacy, and using l’Hopital’s 
rule we find that 


2 jco 0 sm(kn) 2 jco 0 ncos(kn) 2 jco 0 n 2 n 

2 1/2 2 1 ; 2 — CO. CO. 

cop — kco. — kcop 0 0 


0 4 


2 0 


Similarly, for k = - 2 , we get 2 - /G) q sin l^ ;r ) _ -zP , and therefore, 


co,: — k co: 
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2 /m jm(kn) „ cm 

X 2 {jco) = -f X ° / S(oj - *-*> ) 
2 k= ~~co 2 --k 2 co 2 2 


a>„ 


f 2 


f 2 tt" 

j — 

c- 

5(® + ® 0 ) + ^L 

-j — 

V 

2 

1 w o 2 


S(CQ-CO 0 ) 


= jnd(co + CQ 0 )- jnd(co-co 0 ) 


Exercise 5.3 

Find the time-domain signals corresponding to the following Fourier transforms. 

, s w . , j4l(0 + 1 -CO 2 n s . . 

(a) X(jco) = j= - + -<5(m) 


(jco)(j2^2co + 4-co 2 ) 4 


Answer: 


X(jco) = 


isflco + 1 - 


nr 


( j(o){ jlyjlo) + 4 - cy 2 ) 4 


+ ^8(co) 


(jco) 


Umf + Ajw + 1 


( jco)~ + 2 V 2 jco + 4 


3 .1 

n + -/n 


3_ .1 

o 1 n 


- + - 


1 ^ x 

+ x~ + x^ c °) 


{j(o + 4l-j42) (ja + yfl + jyl 2) 4 ja> 4 
From Table D.l (Appendix D) of Fourier transform pairs, 


FT 


X(jco )<-» 
( 

x(t) = 


3 .1 

V 8 % 

( 


e (~j2 + j^), u( f) + 


3_ .1 
v 8 J g, 




x(t) = 2Re< 


? + ' f2+J '^ )t \u(t) + \u(t) 


x(t) = e 


-jit 


^cos(V 2 t)-^-sin(V 2 t) 


u(t) +—u(t) 
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(b) 


AXM»= {Ja + 2 fiJm) 

(jco + 3)(jco + 1) 


Answer: 

Let 5 = /co. Partial fraction expansion: 


*(*) = 


(s + 2) 2 5' 
(5 + 3)(.v + 1) 


. D C D 
= As + B + + - 


5+1 5+3 


-0.5 1.5 

= 5 + + - 


5+1 5+3 

W ■ \ ■ -0-5 1-5 

X(jco) = jco + - - + - 

jco + 1 yco + 3 


FT 

Thus, X(j(o)<r^x(t) = S'(t) + 

V 


1 3 _ 3 , 

-e +-e 


\ 

u(t). 


Exercise 5.4 


Consider the feedback interconnection in Figure 5.32 of two causal LTI differen- 
tial systems defined by S, : Ml + y (t ) = x(t ) S 2 : Ml + 2y(t) = M^ + x(t ) . 


. x(t) = n(t) 


* 



FIGURE 5.32 Feedback interconnection of two LTI systems 
in Exercise 5.4. 


(a) Find the frequency response of the overall system H(jco) and plot its 
magnitude and phase using MATLAB. 
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Answer: 


(jco)Y(jco)+Y(jco) = X(jco) 


H i (jco) = 


Y(jco) 


1 


X(jco) jco + l 
S 2 : (jco)Y(jco)+2Y(jco) = (jco)X(jco)+ X(jco) 
Y(jco) _ jco + l 


HJjco) = 


X(jco) jco + 2 


The overall closed-loop frequency response is obtained by first writing the 
loop equations for the error signal e(t) (output of the summing junction) and the 
output. 


E(jco) = X(jco) + H 2 (jco)H l (jco)E(jco) 
Y(jco) = H l (jco)E(jco) 

Solving the first equation for E( jco), we obtain 


E(jco) = 


Y (jco) = 


1 

1 + H 2 (jco)H 1 (jco) 
Hjjco) 

1 + H 2 {jco)H l (jco) 


X(jco) 

X(jco). 


mm 


Thus, 


H(jco) = 


Hjjco) 

\ + H 2 (jw)H x {jco) 


1 


1 

1 j CO + 1 

jco + 1 jco + 2 


jco + l _ jco + 2 
1 , 1 (yen + 3)(y'cu + 1) 

jco + 2 


Magnitude and phase: 
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H(jco) = 


CO 2 +4 


j 

\lco 2 + 9\f< 


CO " +1 


ZH(jco) = arctan 


v 2 y 


+ arctan 


V 3 j 


+ arctan 


V 1 


Using MATLAB, we obtain the frequency response plots of Figure 5.33. These 
so-called Bode plots have a logarithmic frequency axis and a logarithmic scale for 
the magnitude as well (more on Bode plots in Chapter 8.) 


\mjco)\ 


10 10 10 10 
Z.H ( jCG ) [deg] Frequency (radians/sec) 

0 | =L r= r - n 


-20 
-40 - 
-60 - 
-80 


-100 1— 
10 2 


10 10 
Frequency (radians/sec) 


0) (log) 


FIGURE 5.33 Frequency response of feedback 
system in Exercise 5.4(a). 


(b) Find the output signal y(t) (the step response) using the Fourier transform 
technique and sketch it. 


Answer: 


Y(jco) = H(jco)X(jco) = 


j(Q + 2 

(jco + 3)(jco + \) 


, JO) 


\ 

+ nS(co) 


= + -nd(co) 

(jco)(jco + 3)(jco + 1) 3 

_i _ 1 2 

= — — + — — + — + -nd{co) 
jco + 3 jco + 1 jco 3 
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Taking the inverse transform, we obtain the step response shown in Figure 5.34. 





u(t) 


0 6 •>’(') 

0.5 

0.4 

0.3 

0 . 2 - 

0.1 

O' 

01 23456789 10 


/(s) 


FIGURE 5.34 Step response of feedback system 
in Exercise 5.4(b). 


Exercises 

Exercise 5.5 

Compute the energy-density spectrum of the signal x(t) = e~ 5( '~ 2) u(t- 2). Now, 
suppose that this signal is filtered by a unit-gain ideal bandpass filter with cutoff 
frequencies co cl = 2rad/s , co . 2 = 4rad/s . Compute the total energy contained in the 
output signal of the filter. 

Answer: 

ON THE CD 


Exercise 5.6 

Compute the Fourier transform of the signal x(t) shown in Figure 5.35. 
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Exercise 5.7 


Find the time-domain signal corresponding to the Fourier transform: 
jOJ + l 


X(jco) = 


j4co + 4-co 


Answer: 



ON THE CD 


Exercise 5.8 

Sketch the signal x(t) = w(*-l)] + e -( ' -1) [w(f- 1)- w(t-3)] and com- 

pute its Fourier transform. 


Exercise 5.9 

Find the time-domain signals corresponding to the following Fourier transforms. 
You can use Table D.l of Fourier transform pairs. 


(a) 

(b) 

(c) 


X(jco) = 


X(jco) = 


X(jco) = 


j(Q + 2 
jco(jco + 5) 

jco + 1 


+ ^-8(cq) 


-co 2 + jl'hw + 4 
sin(rn) 
co 


(d) H(jco) = 


co 


< CO <co , 

c 2 


otherwise 


, where co cl < 0 ) cl 
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Answer: 



ON THE CO 


Exercise 5.10 

Compute the Fourier transform of the periodic signal x(t) shown in Figure 5.36. 



FIGURE 5.36 Periodic triangular waveform of Exercise 5.10. 


Exercise 5.1 1 

Find the inverse Fourier transform x(t) of X( jco), whose magnitude and phase are 
shown in Figure 5.37. 



AX(jco) 


— 7l/2 


FIGURE 5.37 Magnitude and phase of Fourier transform in Exercise 5.1 1. 


Answer: 



6 


The Laplace Transform 


In This Chapter 

■ Definition of the Two-Sided Laplace Transform 

■ Inverse Laplace Transform 

■ Convergence of the Two-Sided Laplace Transform 

■ Poles and Zeros of Rational Laplace Transforms 

■ Properties of the Two-Sided Laplace Transform 

■ Analysis and Characterization of LTI Systems using the 
Laplace Transform 

■ Definition of the Unilateral Laplace Transform 

■ Properties of the Unilateral Laplace Transform 

■ Summary 

■ To Probe Further 

■ Exercises 



((Lecture 20: Definition of the Laplace Transform)) 


S o far, we have studied the Fourier series and the Fourier transform for the 
analysis of periodic and aperiodic signals, and linear time-invariant (LTI) 
systems. These tools are useful because they allow us to analyze continuous- 
time signals and systems in the frequency domain. In particular, signals can be 
represented as linear combinations of periodic complex exponentials, which are 
eigenfunctions of LTI systems, but if we replace j CO with the more general complex 
variable s in the Fourier transform equations, we obtain the Laplace transform, a 
generalization of the Fourier transform. 
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The Fourier transform was defined only for signals that taper off at infinity, 
that is, signals of finite energy or signals that are absolutely integrable. On the other 
hand, the Laplace transform of an unbounded signal or of an unstable impulse re- 
sponse can be defined. The Laplace transform can also be used to analyze differ- 
ential LTI systems with nonzero initial conditions. 


DEFINITION OF THE TWO-SIDED LAPLACE TRANSFORM 


The two-sided Laplace transform of x(t) is defined as follows: 

+oo 

X(s) := J x(t)e~ s ‘dt, (6.1) 


where s is a complex variable. Notice that the Fourier transform is given by the 
same equation, but with s = jco. 

Let the complex variable be written as s = <7 + jco . Then the Laplace transform 
can be interpreted as the Fourier transform of the signal x(t)e ~ a ‘ : 

+oo 

X(o + jco) = J -\e~ im, dt. (6.2) 


Given x{t), this integral may or may not converge, depending on the value of 
a (the real part of .v). 

Example 6.1: Let us find the Laplace transform of the signal 

x(t) = e~ a 'u(t), aet shown in Figure 6.1. 



FIGURE 6.1 Real decaying 
exponential signal. 
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X(s) = J e a 'u(t)e s 'dt 

+oo 

= J e~ (s+a) ‘dt 
0 

= — - — , Re{s}>-a (6.3) 

s + a 

This Laplace transform converges only for values of s in the open half-plane to 
the right of s --a. This half-plane is the region of convergence (ROC) of the 
Laplace transform. It is depicted in Figure 6.2. 


f Imfsj 



ROC 


—a 


Refs} 


FIGURE 6.2 Region of convergence of 
Laplace transform of x(t) = e~ at u(t), a e R. 


Recall that the Fourier transform of x(t) = e~ at u(t), ae R converges only for 
a > 0 (decaying exponential), whereas its Laplace transform converges for any a 
(even for growing exponentials), as long as Re{s}>-a. In other words, the 
Fourier transform of x(t)e~ at = e~ (a+a)l u(t) converges for o>-a. 

Example 6.2: Find the Laplace transform of the signal x(t) = e~ a 'u(-t), ael 

shown in Figure 6.3. 



FIGURE 6.3 Real growing exponential 
signal identically zero at positive times. 
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+oo 

X(s) = J e~ a 'u(-t)e~ sl dt 
o 

= J e~ (s+a), dt 

= — , Re{s}<-a (6-4) 

s + a 

This Laplace transform converges only in the ROC that is the open half-plane 
to the left of s = -a (see Figure 6.4). 



■f lm {sj 


Re{s} 


FIGURE 6.4 Region of convergence of 
Laplace transform of x(f) = e~ at u{-t), a e R. 


Important note: The ROC is an integral part of a Laplace transform. It 

must be specified. Without it, we cannot tell what the corresponding time-domain 
signal is. 


INVERSE LAPLACE TRANSFORM 


The inverse Laplace transform is in general given by the following integral: 

j <*+j°° 

x(t):= [ X(s)e s 'ds. (6.5) 

2 *j o-j~ 

This contour integral, where the contour in the ROC is parallel to the imaginary 
axis and wraps around at infinity on the side that includes all the poles of X(s) 
within the contour, is rarely used because we are mostly dealing with linear sys- 
tems and standard signals whose Laplace transforms are found in tables of Laplace 
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transform pairs such as Table D.4 in Appendix D. Thus, in this book we will 
mainly use the partial fraction expansion technique to find the continuous-time sig- 
nal corresponding to a Laplace transform. 

Before turning our attention to partial fraction expansion, let us look at one 
example of how the contour integral and the residue theorem are used to compute the 
inverse Laplace transform of a simple rational function A ( ,v ), s e ROC . Assume for 
simplicity that all the poles of X(s) are distinct. Recall that in the theory of complex 
functions, the residue at the simple pole ,v 0 of a given analytic function X(s) is given 

by Res j=jo { X(s)} = [(s-5 0 )A(s)]^ . For instance, if X(s) = (s+l ^ s+2) , then the 

residue at the pole -2 is given by Res, = 2 { A(.v)] = [(s + 2)X(s)j = - 1. 

The well-known residue theorem in the context of the Laplace transform basi- 
cally states that, given an analytic function F(s) with N poles j p k | , and given a 

simple closed contour C lying in the region of analyticity of F(s ) (here the ROC) 
but encircling all of its poles, the following contour integral evaluates to 

N 

f F(s)ds = 2*r/^Res {f(s)}. (6.6) 

c *=i 

The residue theorem can be directly applied to the contour integral of Equation 
6.5 with F(s) = X(s)e sl and the contour C defined as a vertical line in the ROC, 
wrapping around at infinity in the complex plane so as to encircle all the poles of 
X(s)e s> , which turn out to be the same as the poles of A(.v). 

Example 6.3: Let us compute the inverse Laplace transform of X(s) = ^ , 

a e C, Re{s} > Re{a} . We will see later that the first piece of information that we 
can use is that the ROC is specified to be a right half-plane, which tells us thatx(f) 
will be right-sided. In addition, this Laplace transform is rational, so x{t) will be 
zero at negative times. 

Using Equation 6.5, we get 

] <T+y~ ] 

x(t) = u(t ) [ e s 'ds , <7>Re{a} 

2k i J s — a 

J ( 7 — JOO 

= u(t) — — (27T/')Res \^—e st 
2k j [s — a 

residue theorem 

= e a, u(t). (6.7) 

Similarly, for X(s) = _ 1 , ae C, Rcf.v J < Re{a}, that is, the ROC is specified 
to be a left half-plane to the left of the pole a, we would use a contour C consisting 
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of a vertical line in the ROC wrapping around at infinity in the right half-plane to 
encircle the pole, in the clockwise direction, and we would finally compute the sig- 
nal to be x(t ) = —e a, u{—t ) , where the negative sign in front comes from the fact that 
the contour must be traversed clockwise instead of counterclockwise. 

Partial Fraction Expansion 

In the previous example, we were able to find the inverse Laplace transforms of 
two first-order Laplace transforms, one leading to a right-sided complex exponen- 
tial signal, and the other leading to a left-sided complex exponential signal. These 
two inverse transforms are the foundation for a technique known as partial fraction 

r I N 

expansion. Assuming there is no multiple-order pole in the set of poles | p k J of 
the rational transform X(s), and assuming that the order of the denominator poly- 
nomial is greater than the order of the numerator polynomial, we can always ex- 
pand X(s) as a sum of partial fractions: 




A, 


~i s ~Pk 


*=i 


(6.8) 


From the ROC ofX(s), the ROC of each of the individual terms in Equation 6.8 
can be found, and then the inverse transform of each one of these terms can be de- 

A 

termined. If the ROC of the term pfj is to the right of the pole at ,v = p. , then the 
inverse transform of this term is A.e Pi 'u(t), a right-sided signal. If, on the other 
hand, the ROC is to the left of the pole at s = p j for the term pfj, then its inverse 
transform is -A.e p, ‘u(-t), a left-sided signal. Note that the poles and their associ- 
ated coefficients can be real or complex. Adding the inverse transforms of the in- 
dividual terms in Equation 6.8 yields the inverse transform ofX(s). 

The technique of partial fraction expansion of a rational Laplace transform is 
introduced here and will be illustrated by means of a few examples. As discussed 
above, the idea behind the partial fraction expansion is to expand a Laplace trans- 
form X(s) as a sum of first-order rational functions. Assuming for the moment that 
X(s) has distinct poles j p k } , each one of the first-order fractions contains one of 

the poles: 




A, 


A , 


A, 


- + ••• + - 


A, 


~ s ~P k 


seROC 


S P\ s-p 2 

seROC t seROC 2 



(6.9) 


Then, using Table D.4 of Laplace transform pairs, one can easily obtain the 
time-domain signal x(t). Assuming that the ROC of A(.v) is an open right half-plane, 
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then all the ROCs of the partial fractions must also be open right half-planes for 
consistency. In fact, ROC of X(s) must at least contain the intersection of all the 
ROCs of the fractions ROC □ Q ROC . . Then we have 


x(t) = A x e Pi 'u{t) + A 2 e P2 'u{t ) H 1- A N e PN ‘u(t). (6.10) 

If the ROC of X(s) is an open left half-plane, then all the ROCs of the partial 
fractions must also be open left half-planes, and we get 

x(t) = -A l e Pl> u(-t)- A 2 e Plt u(—t) A N e PN 'u(-t). (6.11) 


The last case to consider for X(s) with distinct poles is when the ROC of T(.v) 
is an open vertical strip between two adjacent poles, for example, p m to the left and 
p m+ i to the right, without loss of generality. In this case, all the poles to the left of, 
and including, p m must have their ROCs as open right half-planes, and all the poles 
to the right of, and including, p m+l must have their ROCs as open left half-planes. 
Then, ROC □ Q ROC . holds and we have 


£ 0 ) 

Re{ P m }<Re{i }<Re{p m+1 } 


A 


A 


A 


+ ••• + 


m + 1 


A 


+ ••• + 


N 


■ Pi 


Re{i}>Re{pj} R e {s}>Re{p 2 } 


Re{i}>Re{^} Re{s}<Re{^ m+1 } 


RejiKRefp^} 


. ( 6 . 12 ) 


For multiple poles inX(s), the partial fraction expansion must contain fractions 
with all the powers of the multiple poles up to their multiplicity. To illustrate this, 
consider X(s) with ROC Rc{.yj > Rc [ /; v } and with one multiple pole p m of multi- 
plicity r, that is, 


X(s) = - 


n(s) 


(s- P] y-is- p m _ x )(s - pj (s - P m+l y--(s-p N ) 
where n(s) is the numerator polynomial. Its partial fraction expansion is 


X(s) = 

Re{s}>Re{/> w } 


A , 


A 


A 


m+\ 


s- 


Pi 


Re{5}>Re{/7j} 


A 


r p -. + (s-p„f 

Re{5}>Re{» } 


+ ••• + 


A 


m+r — 1 


Re{s}>Re{/? m } 


( s ~pJ 




+ ••• + 


s- p 


m + 1 


A 

N+r - 1 

s ~Pn 


(6.13) 


(6.14) 


Re{s}>Re{/P m+1 } 


Re{«}>Re{p w } 





230 Fundamentals of Signals and Systems 


The question now is. How do we compute the coefficients A t for a given 
Laplace transform? For a single pole p k , coefficient A k is simply the residue at the 
pole, that is, 


A = Rcs s- Pl { x (*)} = [0-/>*)*0)] s ^ t 


Example 6.4: Let us compute the inverse of the following Laplace transform: 


* 0 ) = 


s + 3 

+ 1)0 - 2 ) ' 


0 < Re{s} < 2. 


X(s) = 


s + 3 


s(s + 1)0 - 2) 

A A ' A 

: — — + -L + — L_ 

.v + 1 s s -2 

sgROC, sgROC , sgROC , 


0<Re{s}<2 


(6.15) 


(6.16) 


In order to have ROC □ ROC[ n ROC 2 n ROC 3 , the only possibility for the 
individual fractions’ ROCs is the following: 


ROC( = {.v e C : Re{s} > -1} , ROC, = {s e C : Re{s} > 0}, ROC 3 = {s e C : Re{s} < 2} . 


Thus, 


* 0 ) = + 

s + 1 


4 

s 


+ 


4 _ 

s-2 


Re{s}>-1 Re{s}>0 Re{s}<2 


We compute coefficient A x : 


( 


0 + 3 ) 


4=0 + 1 ), 

\ S(S + 1 ) 0 - 2 )) s= _, ( — 1 )( — 3 ) 3 

Then, we obtain coefficient A 2 : 


A 2 — s 


0 + 3 ) 


UO + l)O-2)J J=0 (1)(— 2) 


(6.17) 


(6.18) 


(6.19) 
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Finally, coefficient A 3 is computed: 


A 3 = (s — 2) 


(s+ 3 ) 


U(.v + l)(^-2)J rf (2)(3) 6 


( 6 . 20 ) 


Flence, the transfer function can be expanded as 

2 1 3 1 5 1 

3 s_4vl 2 5 6 s — 2 i ’ 

Re{.s}>-1 Re{.s}>0 Re{s}<2 

and from Table D.4 of Laplace transform pairs, we obtain the signal 

2 3 5 

x(t) = —e~'u(t) u{t) e 2 'u(—t). 

3 2 6 


( 6 . 21 ) 


( 6 . 22 ) 


For a multiple pole p m of multiplicity r, the coefficients A m , . . A m+r _ j are com- 
puted as follows: 

A (6 - 23) 

where 0! = 1 by convention. To compute the coefficient of the term with the high- 
est power of the repeated pole, we simply have to compute 

^-^[(^-^r^)]^. (6.24) 

It should be clear that after multiplication by ( s - p rn ) r on both sides of Equa- 
tion 6.14, all the terms on the right-hand side will vanish upon letting s = p m , 

A m „_ t 

except the term ^ _ p j, which yields A m+r _ t . Now, consider the computation of 
A m+r _ 2 using the formula A m+r _ 2 = [(.s'-p^/AA)] . After multiplication by 

(. s-PmY , the terms on the right-hand side corresponding to the multiple pole 
become 

{s-Pm)’ 'An+is-PmJ ' 4*1 + ‘ ' ' + (' * “ Pm )■ A ,n + r-2 + 4»W* (6-25) 

After differentiating with respect to s and letting s =p m , we obtain 

(r-l)(s- pj 2 A m +(r-2)(s- p m )' 3 A m+l + ■■■ + 2 (s- p m ) A m+r _ 3 + A m+r _ 2 ] 

- A 

' m+r-2 


(6.26) 
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All the other terms of the partial fraction expansion disappear. 

In practice, differentiating X(s) can be tedious. Thus, at least for a pen and 
paper solution of a simple problem with only one double pole, one can compute co- 
efficient A m+1 as in Equation 6.24, and the other coefficient A m can be computed by 
multiplying both sides of the partial fraction equation by ( s - p m ) and by letting 
j— >oo, which yields 

A m = [(s-.PmW 5 )]^ ~(4 + A; + ••• + A m _j +A m+2 + ••• + Ajv). (6.27) 


Example 6.5: 

X(s) = 


5-2 


(5 + l)(.v + 3) 2 5 + 3 (,v + 3) 2 5 + 1 


+ -^-, Re{5}>-1 


S =- 1 


Let us compute coefficient A 3 first: 
(5 + 3)- 

We then compute coefficient A 2 : 

= 

S + 1 s=—3 

Finally, coefficient A x is found: 

S_2 


3 

4' 


(5 + l)(5 + 3) 



f 3 " 

s — >©o 

V 4 , 


3 

4' 


Hence, we have 


X ( 5 ) = --^+ 5 1 


3 1 


4 5 + 3 2 (5 + 3) 2 4 5 + 1 


Re{s}>-3 


Re{.s}>-3 


Re{s}>-1 


(6.28) 


(6.29) 


(6.30) 


(6.31) 


(6.32) 


We can check that this partial fraction expansion is correct by bringing all the 
terms together with a common denominator: 
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X(s) = 


3 1 5 1 3 1 

4 5 + 3 2 (s + 3) 2 4nl 

3(5 + 1)Q + 3) + 10(5 + 1) - 3(5 + 3 ) 2 
4(5 + l)(5 + 3) 2 

35 2 + 12.5 + 9 + 10.5 + 10- 35 2 - 185-27 
4(5 + l)(5 + 3) 2 


4.5-8 _ 5-2 

4(5 + l)(5+3) 2 _ (5 + 1)(5 + 3) 2 ' 


Finally, using Table D.4 of Laplace transform pairs, we obtain 


x(t) = 



5 

+ — te 
2 



u(t) 


(6.33) 


(6.34) 


A pair of complex conjugate poles in a Laplace transform can be dealt with in- 
dividually using the residue technique outlined above. The two complex coeffi- 
cients obtained are complex conjugates of each other. A pair of complex conjugate 
poles can also be treated by including a second-order term in the partial fraction ex- 
pansion. The idea is to make use of the damped or growing sinusoids in the table 
of Laplace transforms, such as 


e “'sin((O n t)++ ^ Re{.v}>-a, 

(5 + a)~+<y 0 

(6.35) 

L s ~\~ oc 

e~ at cos (cn 0 t)++ r Re{.v} > -a 

(5 + a)‘+cn 0 ‘ 

(6.36) 


. . Aio„ + B(s + a) . , . , - . . T . , , 

by creating a term u+a) 2 +fl) 2 m the partial traction expansion. It is perhaps best to 
explain this technique by means of an example. 


Example 6.6: Let us compute the inverse of the following Laplace transform: 


X(s) = 


2s 2 + 35-2 
^ 5 2 + 2.5 + 4 ) 5 ’ 


Re{5} > 0. 


(6.37) 


Note that s 2 +25 + 4 = (5 + l) 2 +(V3) 2 , so that the complex poles are 
P] = -1 + y V 3 and P\ = ~ 1 _ jV 3 . The transform X(.s) can be expanded as follows: 
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x 2s 2 + 3^-2 Ay/3 + B(s + l ) C 

= >-= 2 + _ . 

(r + 25 + 4^5 (.v + l)'+3 _s~ 

Re{s}>0 


(6.38) 


Re{j}>-1 


Coefficient C is easily obtained with the residue technique: C = 2 . Now, let 


-3 1 


A 


s — 1 to compute — =^j^+- =>^ = — , and then multiply both sides by 5 and let 
s — > oo to get 5 = 5/2. Then we have the following expansion: 


X(s) = 


^(V3) + |(.v + l) 
(s + 1) 2 + 3 


Re{s}>-1 


. Ill 

^_S_^ 

Re{,s}>0 




(V3) 


-Cv-hl) 


- + - 


1/2 


(^ + 1) +3 (5 + 1) +3 ^ 

v v ' K v ' Re{s}>0 

Re{s}>-1 Re{,s}>-1 

Taking the inverse Laplace transform using Table D.4, we obtain 


(6.39) 


x(t) = 


R 5 

— e~’ sin(V3 1) + — e~' cos( V3f ) 




(6.40) 


CONVERGENCE OF THE TWO-SIDED LAPLACE TRANSFORM 


As mentioned above, the convergence of the integral in Equation 6. 1 depends on 
the value of the real part of the complex Laplace variable. Thus, the ROC in the 
complex plane or 5-plane is either a vertical half-plane, a vertical strip, or nothing. 
We have seen two examples above that led to open half-plane ROCs. Here is a sig- 
nal for which the Laplace transform only converges in an open vertical strip. 

Example 6.7: Consider the double-sided signal x{t) = e~ 2 ' u(t)+e u(—t) shown in 

Figure 6.5. 
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FIGURE 6.5 Double-sided signal. 


Its Laplace transform is given by 

+oo +oo 

X(s)= | e~ 2 ‘ u{t)e~ s ‘ dt + J e'u{-t)e~ s ‘dt 
= J e Hs+2), dt + J e- (s - ]>, dt 

0 -=o 

= — - — , Re{.v} > -2 and Re{s} < 1 

S + 2 5 — 1 

= , - 2 < Re{.v} < 1 (6.41) 

S~ +5 — 2 

The ROC is a vertical strip between the real parts -2 and 1, as shown in Fig- 
ure 6.6. 



i 

l lm{s} 
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FIGURE 6.6 Region of convergence of 
Laplace transform of the double-sided signal. 


POLES AND ZEROS OF RATIONAL LAPLACE TRANSFORMS 


Complex or real exponential signals have rational Laplace transforms. That is, they 
are ratios of a numerator polynomial and a denominator polynomial. 
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X(s) = 


n(s) 

d(s) 


(6.42) 


The zeros of the numerator n(s) are called the zeros of the Laplace transform. 
If z, is a zero, then X(z l ) = 0 ■ The zeros of the denominator d(s) are called the 
poles of the Laplace transform. If p x is a pole, then X(p x ) = °° . 


25 + 1 

Example 6.8: X(s) = j2 + i _ 2 , - 2 < Refs} < 1 has poles at p x = 1, p 2 =- 2. 

For differential LTI systems, the zeros of the characteristic polynomial are 
equal to the poles of the Laplace transform of the impulse response. 



(( Lecture 21: Properties of the Laplace Transform, Transfer Function of an LTI 
System)) 


PROPERTIES OF THE TWO-SIDED LAPLACE TRANSFORM 


The properties of the two-sided Laplace transform are similar to those of the 
Fourier transform, but one must pay attention to the ROCs. Take for example the 
sum of two Laplace transforms: the resulting Laplace transform exists if and only 
if the two original ROCs have a nonempty intersection in the complex plane. Note 
that the properties of the Laplace transform described in this section are summa- 
rized in Table D.5 of Appendix D. 

Linearity 

L L 

The Laplace transform is linear. If s e ROC, and x 2 (t)<->X 2 (s), 

s e ROC 2 , then 

axft) + bx 2 (t)<r^aX 1 (s) + bX 2 (s), s <e ROC □ ROCj nROC 2 . (6.43) 


Time Shifting 

If x(t)<r->X(s), s e ROC , then 

x(t-t 0 )<r^e~ s '°X(s), s' e ROC. (6.44) 


Example 6.9: Consider an LTI system with an impulse response that is a unit 

rectangular pulse of duration T\ h(t) = u(t ) - u(t - T) . Then 
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H(s) = --e~ sT -= 1 g , V,v. (6.45) 

s s s 

Note that the ROC is the whole complex plane because the impulse response 
is of finite support. There is no pole at s = 0. 

Shifting in the s-Domain 

If x(t)<->X(s), s e ROC , then 

e s °'x(t)<r^X(s- s Q ), s e ROC+Re{s 0 }, (6.46) 

where the new ROC is the original one shifted by Re{s 0 }, to the right if this num- 
ber is positive, to the left otherwise. 

Time Scaling 

If x(t)<r^X(s), seROC,then 

L 1 / \ } 

x(at)<r-> — X — , se- ROC, (6.47) 

\a\ a 

where the new ROC is the original one, expanded or contracted by l/|a| and 
flipped around the imaginary axis if a < 0. 

Example 6.10: Consider a signal x(t) whose Laplace transform has the ROC 

shown on the left in Figure 6.7. After the time expansion and reversal x(-0.5f) , the 
resulting Laplace transform has the ROC shown on the right in Figure 6.7. 


x(-0.5t)<->2X(-2s), s g -2ROC 


(6.48) 


A Im{s } 



■ k Im{s } 
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FIGURE 6-7 Expansion of region of convergence after time scaling. 
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Conjugation 

If x(f)<->X(s), s <e ROC, then 

x\t)<r->X*(s*), s' e ROC. (6.49) 

Therefore, forx(t) real, X(s) = X‘(sj. 

An important consequence is that if x(t) is real and X(s) has a pole (or zero) at 
s = s 0 , then X(s) has also a pole (or zero) at the complex conjugate point s = s* . 
Thus, the complex poles and zeros of the Laplace transform of a real signal always 
come in conjugate pairs. 


Convolution Property 

If X!(0 <->A,(s), seROC, and r 2 (l)Al 2 (j), seROC,,then 

Xj (t)*x 2 (t)<r^X 1 (s)X 2 (s), s e ROC □ ROC, nROC,. (6.50) 


This is of course an extremely useful property for LTI system analysis. Note 
that the resulting ROC includes the intersection of the two original ROCs, but it 
may be larger, for example, when a pole-zero cancellation occurs. 

Example 6.11: The response of the LTI system with h(t) = j^e~ 2 ' + e~‘ Jw(t) to the 

input x(t) = - e~ 2, u(t ) + 8( t) is given by the inverse Laplace transform of Y(s): 


/7(t)<-> H(s) = 
x(t)<->X(s) = 


2s + 3 

(7+2x7+!)’ 


Re{5> >-l 


-1 
s + 2 


+ 1 = 


5 + 1 

5 + 2’ 


Re{5} > -2 


(6.51) 


and 


Y (s) = H(s)X(s ) = ( (5 : Refs} > -2} n {5 : Re{s} > -1} = {s : Refs} > -1} 

(s + 2)(s + l) (5 + 2) 

_ (2.v + 3) , > _2 ( a f ter the pole-zero cancellation). 

(s + 2)“ 


(6.52) 


Expanding this transform into partial fractions, we get 


Y(s) = 


(25 + 3) 
(5 + 2) 2 


A B 
(5 + 2) (5 + 2) 2 ’ 


Re{5}>-2. 


(6.53) 
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We find coefficient B first: 


(2s + 3) 


1 

and coefficients is then obtained: 

2s + 3 


= -1 = 5 , 


(6.54) 


s + 2 


= 2 = A. 


(6.55) 


Therefore, using Table D.4 of Laplace transform pairs, we obtain 


y(t) = j^2e 21 - te 21 u(t). 


(6.56) 


Differentiation in the Time Domain 

If x(t)<->X(s), se ROC, then 

^^AsX(s), seROC, 3ROC, (6.57) 

dt 

ROC, can be larger than ROC, namely when there is a pole-zero cancellation 
at s = 0. 

Differentiation in the Frequency Domain 

If x(t)£>X(s), seROC, then 

-tx(t)<r^ ^^ S \ seROC. (6.58) 

ds 

This property is useful to obtain the Laplace transform of signals of the form 
x(t) = te~ a 'u(t) . 

Integration in the Time Domain 

If Jt(/)Ax(s), seROC, then: 

J' x(T )drA-X(s), seROC, □ROCn{s:Re{s}>0}. (6.59) 
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For example, since the unit step response of an LTI system is given by the run- 
ning integral of its impulse response s(t) = J' h(z)dz , we have S(s ) = - H(s ) 
with the appropriate ROC. Note that ROC, can be bigger than the intersection, 
namely when there is a pole-zero cancellation at s = 0. 

The Initial and Final Value Theorems 

Under the assumptions that x(t) = 0 for t < 0 and that it contains no impulse or 
higher order singularity, one can directly calculate the initial value x (() + ) and the 
final value x(+°°) using the Laplace transform. 

The initial-value theorem states that 

x(0 + ) = lim sX(s), (6.60) 

s— »+oo 


and the final-value theorem states that 

lim x(t) = limOf(s). (6.61) 

H-°o s— >0 

A typical use of the final-value theorem is to find the settling value of the out- 
put of a system. 

Example 6.12: Let us find the final value of the step response of the causal LTI 

• ^ $ “F 1 

system with h(t)<r^H(s) = — , Re{.v} > -4, shown in Figure 6.8. 

v(+°°) = limsTO) = lim x- ^ + ^ =— (6.62) 

s->o ho s(s + 4) 4 


x(t) 


u(t) 



A' + l 


► 

5+4 

W 


y(t) 


FIGURE 6.8 System subjected to a step input. 


Note that in the above example, the multiplication by 5 cancels out the output’s 
pole at the origin. Thus, it is sufficient to evaluate the system’s Laplace transform 
at s = 0 to obtain the final value. This is true for most problems of this type, that is, 
finding the final value of the step response of a system. 
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ANALYSIS AND CHARACTERIZATION OF LTI SYSTEMS 
USING THE LAPLACE TRANSFORM 


We have seen that the convolution property makes the Laplace transform useful to 
obtain the response of an LTI system to an arbitrary input ( with a Laplace trans- 
form). Specifically, the Laplace transform of the output of an LTI system with im- 
pulse response h(t) is simply given by 

Y(s) = H(s)X(s), ROC y 3ROC H nROC x . (6.63) 

Also recall that the frequency response of the system is H(jco ) = A/(.v) . 

The Laplace transform H(s) of the impulse response is called the transfer func- 
tion. Many properties of LTI systems are associated with the characteristics of 
their transfer functions. 

Causality 

Recall that h(t) = 0 for t < 0 for a causal system and thus is right-sided. Therefore, 
the ROC associated with the transfer function of a causal system is a right half-plane. 

The converse is not true. For example, a right-sided signal starting at t = - 10 
also leads to an ROC that is a right half-plane. However, if we know that the trans- 
fer function is rational, then it suffices to check that the ROC is the right half-plane 
to the right of the rightmost pole in the .v-planc to conclude that the system is 
causal. 

Example 6.13: The transfer function H{s) = ^ , Re{s} > -1 corresponds to a 

causal system. On the other hand, the transfer function Hfs) = , Rc{.v| > -1 is 

noncausal (causal h(t) time-advanced by 1), whereas Hfs) = , Re{s}>-1 is 

causal (causal h(t) time-delayed by 1). 

Stability 

So far, we have seen that bounded-input bounded-output (BIBO) stability of a 
continuous-time LTI system is equivalent to its impulse response being absolutely 
integrable, in which case its Fourier transform converges. Also, the stability of an 
LTI differential system is equivalent to having all the zeros of its characteristic 
polynomial having a negative real part. 

For the Laplace transform, the first stability condition translates into the 
following: 

■ An LTI system is stable if and only if the ROC of its transfer function contains 
the jco- axis. 
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Example 6.14: Consider an LTI system with proper transfer function: 


H(s) = 


5(5 + 1) 

(s + 2Xs-l) 


(6.64) 


Three possible ROCs could be associated with this transfer function. Table 6. 1 
gives the impulse response for each ROC. Only one ROC leads to a stable system. 
Note that the system poles are marked with an X and the system zeros are marked 
with an O in the 5-plane. 

First, let us compute the partial fraction expansion of H(s): 


x 5(5 + 1) . B C 

H(s ) = — = A + + - 


(5 + 2)(5-l) 5-1 5 + 2 

To obtain A, let 5 — » °° : A = 1 . Then, we find the coefficient B: 


(6.65) 


B = 


5(5 + 1) 


(5 + 2) 


2 

3 : 


(6.66) 


and finally we get coefficient C: 


C = 


5(5 + 1) 


(5-1) 


2 

3' 


(6.67) 


Hence, the transfer function can be expanded as 


H(s) = 


5(5 + 1) 

(5 + 2)(5 - 1) 


2 1 2 1 
1 4 . 

35—1 35+2 


(6.68) 


The first term is constant and corresponds to an impulse 8(t ) . The two other 
terms are partial fractions that can correspond to right-sided or left-sided signals, 
depending on the chosen ROCs, as presented in Table 6.1. 

The stability condition for a causal LTI system with a proper, rational trans- 
fer function is stated as follows. Note that a large class of causal differential LTI 
systems have rational transfer functions. 


■ A causal system with a proper rational transfer function H(s ) is stable if and 
only if all of its poles are in the left-half of the 5-plane; that is, if all of the poles 
have negative real parts. 
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TABLE 6.1 Correspondence Between a Transfer Function and Its Impulse Response Depending 
on the ROC 


ROC 


m 


Causal Stable 


Im{s} 


j ROC 


-* — o — 6 — ^ 

-2-1 II 


Re{s> 




U (t)+S(t) 


Yes No 

ROC is 
a right 
half-plane 


l ROC 


Im{sj 


-^— 0 — 6 —^ 
-2j -1 1 1 


Re{s} 




/7(f) = -|e'u(-f)-|e- 2f u(f) 

+m 


No 


Yes 

jco - axis 
lies in the 
ROC 



No No 


Notice that the transfer function must be proper; otherwise when the degree of 
the numerator exceeds that of the denominator, the impulse response contains the 
derivative of an impulse that is not absolutely integrable. 



((Lecture 22: Definition and Properties of the Unilateral Laplace Transform)) 


DEFINITION OF THE UNILATERAL LAPLACE TRANSFORM 


The one-sided, or unilateral, Laplace transform of x(t ) is defined as follows: 


T(x) := J x(t)e s 'dt, 
0“ 


(6.69) 
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where 5 is a complex variable. Notice that this transform considers only the sig- 
nal for nonnegative times. The lower limit of integration is t = 0“ , which means 
that singular functions such as impulses at t = 0 will be taken into account in the 
unilateral Laplace transform. 

We will use the following notation for the unilateral Laplace transform: 

UL 

x(t)<r^'X(s)=UC{x(t)}. (6.70) 

Note that two signals that differ for t < 0 but are equal for t > 0 will have the 
same unilateral Laplace transform. Also note that the unilateral Laplace transform 
of x(t) is identical to the two-sided Laplace transform of x(t)u(t ) , assuming there 
is no impulse at t = 0. A direct consequence of this is that the Laplace transform 
properties for causal, right-sided signals apply to the unilateral transform as well. 
Moreover, the ROC of a unilateral Laplace transform is always an open right half- 
plane or the entire .v-planc. 


PROPERTIES OF THE UNILATERAL LAPLACE TRANSFORM 


The properties of the unilateral Laplace transform are identical to those of the reg- 
ular two-sided Laplace transform, except when time shifts are involved, which can 
make part of the signal “disappear” to the negative times. Note that the following 
properties are summarized in Table D.6 of Appendix D. 

Linearity 

UL 

The unilateral Laplace transform is linear. If x.(t)<->T.(s), seROC. and 

UL 111 

x 2 (?)<-> T 2 ( s ), s e ROC 2 , then 

ax ] (t) + bx 2 (t) <e-> aT, (.s) + b'X 2 (.s), s e ROC ROC-j n ROC,. (6.71) 


Time Delay 

UL 

For x(f) = 0, t<0, if x(t)<->%(s), s€ ROC, then for a time delay of ? 0 >0, 

UL 

x(t-t 0 )<r^e °3f(s), s e ROC, t 0 > 0. (6.72) 

Thus, for a time delay, this time-shifting property is exactly the same as that for 
the two-sided Laplace transform. In the case where x(t) is nonzero at negative 
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times, a time delay can make a part of the signal “appear” at positive times, which 
could change the unilateral Laplace transform. For a time advance, the part of the 
signal shifted to negative times is lost. In both of these cases there is no simple re- 
lationship between the resulting and the original unilateral transforms. 

Shifting in the s-Domain 

UL 

If se ROC, then 

, UL 

e s ° se ROC+Re{s 0 }, (6.73) 

where the new ROC is the original one shifted by Rc {.v (| }, to the right if this num- 
ber is positive, to the left otherwise. 

Time Scaling 

UL 

If x( t)<r^'Z(s), s e ROC , then for a > 0, 

— s e= — ROC, (6.64) 

a \(x) a 

where the new ROC is the original one, expanded or contracted by 1/a . 

Conjugation 

UL 

If x(t)<r^'X(s), se ROC, then 


UL 

x*(t)<r+ %*(/), seROC. (6.75) 

Therefore, for x(t) real, T(.v) = T (.v ), and we have the important conse- 
quence that the complex poles and zeros of the unilateral Laplace transform of a 
real signal always come in conjugate pairs. 

Convolution Property 

UL 

Assume that xft) = xft) = 0 for t < 0. If xff^'Xfs), s e ROCj and 

UL 

x 2 ( t)<r -> (s), 5 G ROC 2 , then 

UL 

x ] (t) * x 2 (t) <e-> T, (s)'X 1 (.s), s e ROC □ ROCj n ROC 2 . (6.76) 

This is a useful property for causal LTI system analysis with signals that are 
identically zero at negative times. 
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Differentiation in the Time Domain 

The differentiation property of the unilateral Laplace transform is particularly useful 
for analyzing the response of causal differential systems to nonzero initial conditions. 

UL 

If x{t) s g ROC, then 

dx(t\ UL 

— s e ROC, □ ROC. (6.77) 

ROC| can be larger than ROC when there is a pole-zero cancellation at s = 0. 
Note that the value x((f ) is 0 for signals that are identically 0 for t < 0, but not for 
signals that extend to negative times. Furthermore, x(0“) can be used to set an ini- 
tial condition on the output of a causal differential system as shown in Example 6. 15. 

Example 6.15: Let us calculate the output of the following homogeneous causal 

LTI differential system with initial condition y( 0“ ) : 


dy(t) 

h — + H,) = 0. 


We take the unilateral Laplace transform on both sides: 
T 0 [sty(s)-y(0-)'] + ty(s) = 0. 
Solving for %(s), we obtain 

%(s) = y ^° ? , Re{^} , 

S H T o 

which corresponds to the time-domain output signal: 

t 

y(t) = y(0~)e T °u(t). 


(6.78) 


(6.79) 


(6.80) 


(6.81) 


Note that the unilateral Laplace transform of the n' h -order derivative of x( t) is 
given by the following formula, which is derived by successive applications of 
Equation 6.77 . 


d n x(t ) 

n 


<r^S n, X(s)-S n ‘xfO 


d"~ 2 x(0~) d"~ 1 x(0~) 


df 


dt" 


s e ROC, □ ROC 


dt 


(6.82) 
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Differentiation in the Frequency Domain 

UL 

If x(t) <->T(s), SE ROC, then 

tx(t s e ROC, (6.83) 

ds 


Integration in the Time Domain 

UL 

If x(t)<r^'X(s), se ROC, then 


[ x(z)dT^-‘Z(s), 5eROC[ □ROCn{5':Re{.v}>0}. 

J 0 e 


(6.84) 


The Initial and Final Value Theorems 

Even though these theorems were introduced as two-sided Laplace transform prop- 
erties, they are basically unilateral transform properties, as they apply only to sig- 
nals that are identically 0 for t < 0. 

The initial-value theorem states that 

x(0 + )= \xms'X(s), (6.85) 

S— >+oo 

and the final-value theorem states that 

lim x(t) = limsT(s)- (6.86) 

S ->0 


Example 6.16: Let us find the initial value x(0 + ) of the signal whose unilat- 
eral Laplace transform is Re{s}>3: 

x(0 + ) = lim s%(s) = lim = 10. (6.87) 

s— >+oo s — >+oo £ — ^ 


SUMMARY 


In this chapter, we introduced the Laplace transform of a continuous-time signal as 
a generalization of the Fourier transform. 
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■ The Laplace transform can be defined for signals that tend to infinity, as long 
as the integral converges for some values of the complex variable .v. The set of 
all such values in the complex plane is the region of convergence of the 
Laplace transform. 

■ The inverse Laplace transform is given by a contour integral in the complex 
plane, and the residue theorem can be used to solve it. However, the Laplace 
transforms that we have to deal with in engineering are often rational functions, 
and these can be inverted by first expanding the transform into a sum of partial 
fractions, and then by using a table of basic Laplace transform pairs. The 
region of convergence of each individual fraction must be found to select the 
correct time-domain signal in the table. 

■ We discussed many of the properties of Laplace transforms, but one is partic- 
ularly useful in engineering: the convolution property, which states that the 
Laplace transform of the convolution of two signals is equal to the product of 
their Laplace transforms. This allows us to compute a convolution, for exam- 
ple, to obtain the output signal of an LTI system, simply by forming and in- 
verting the product of two Laplace transforms. 

■ The Fourier transform of a signal is simply equal to its Laplace transform eval- 
uated on the jco- axis, provided that it is included in the region of convergence. 

■ The unilateral Laplace transform was introduced mostly for its differentiation 
property, which proves particularly useful in solving for the response of dif- 
ferential systems with initial conditions. 


TO PROBE FURTHER 


References on the Laplace transform include Oppenheim, Willsky, and Nawab, 
1997; Kamen and Heck, 1999; and Haykin and Van Veen, 2002. The theory of 
complex variables and complex functions is covered in Brown and Churchill, 2004. 


EXERCISES 

Exercises with Solutions 

Exercise 6.1 

Compute the Laplace transforms of the following three signals (find the numerical 
values of (O 0 and 6 in (c) first). Specify their ROC. Find their Fourier transforms if 
they exist. 


(a) x, (t) = lOe (r 2) u(t - 2) + I0e ° 5( ' 2) u(-t + 2) as shown in Figure 6.9. 
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FIGURE 6.9 Double-sided signal of Exercise 6.1 (a). 


Answer: 

Using Table D.4 and the time-shifting property, we get 


Jtj( t) = 10 e H, ~ 2) u{t - 2) + 10 e 0M, - 2) u(-t + 2) 

= 10 e~ ( '~ 2) u(t - 2) + 10 e 0M, - 2) u(-(t - 2)) 


-2 s 


Xj(s) = 10 


Re{.v}>-1 


— 10 ■ 


5-05 

Re{s}<0.5 


= I0e 


-2 s 


s -0.5 -5-1 


(5 + l)(5-0.5) 


, - 1 < Re{.v} < 0.5 


-15e“ 


(5 + l)(5-0.5) 


, - 1 < Re{.v} < 0.5. 


The Fourier transform exists since the ROC contains the imaginary axis, that 
is, 5 = jco . It is given by 


X ] (jco) = 


-15e~ 2J< ° 

(jco + l)(jca -0.5) 


l5e~ 2J<0 

(0.5 + <y 2 )-0.5 jco 


(b) Signal x 2 (t) shown in Figure 6.10. 
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FIGURE 6.10 Sawtooth signal of 
Exercise 6.1 (b). 


Answer: 

We can compute this one by using the integral defining the Laplace transform. Here 
x 2 (t) has finite support; hence the Laplace transform integral converges for all s. 




5 r 

(s) = — j te s 'dt 


5 te 


3 s 


5 rJ 

+ — f e~ s, dt 

tJ-3 


3 


5 3e~ 3s + 3e 3s 5(e~ 3s -e 3s ) w 

t : t 3 


5e~ 3s +5e 3i 5 0“ 3 *-e 3s ) 


, Vs 


(-15s-5K 3s -(15s-5> 3 


3s 2 

(-5s-5/3) e - 3s -(5s-5/3)e 3 


Vs 




The Fourier transform of this signal is given by 
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(-5 jco - 5/3)e~ Vo} - (5 jco - 5/3)e 


X 2 (jco) = 


3jco 


-CO' 


-5 jo)(e Vm +e~ 3Jm ) + 5/3(e ijm -e~ ija ) 


3jo> _ -3 jco \ 


- CO ' 


5 j{e ija + e- ija ) 5/3 - e~ Jy<0 ) 

CO co 2 

10 _/ cos(3cu) 10 _/ sin(3co) 


= 10 j 


co 3 co' 

3co cos(3 co) - sin(3cy) 
3 co 2 


It is odd and purely imaginary, as expected. Applying L’Hopital’s rule twice, 
we can also check that X 2 (jO) is finite, as it should be. 

(c) Damped sinusoid signal x 3 (t) = e~ Wt sin(co 0 t + 6)u(t) of Figure 6.1 1. 



FIGURE 6.1 1 Damped sinusoid signal of 
Exercise 6.1 (c). 


Answer: 

Let us first find the values of the parameters 6 and co 0 . We have 

x 3 (0) = 0.5 = sin(0) 

8 = arcsin(0.5) 

6 
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and 


7T 


x 3 (0.2) = 0 = e sin(0.2« 0 + — ) 

6 


n 


«0.2fflJ — = kn, k eZ 


here k = 2 


— . _ 7T 

cm =5 2 tt 


55tt 


rad/s 




The signal’s Laplace transform can be obtained as follows: 

. . _10? ■ ,55 71 7T 

x 3 (t) = e sin( 1-\ — )u(t) 


( 55 TZ K 55 k Jl \ 

I t+J— -J t-J— 

e 6 6 —e 6 6 


= £ 


= e 


2j 


u(t ) 


J 


f .n . 55 n 


. 55 n \ 


i— i 1 -j— -j 1 

e *e 6 -e 6 e 6 


2 j 


u(t) 


= e 


2 y'Im< e 6 e 


.n . 55 n 


2 j 


u(t ) 


7T . 557T . n 55n 

= e | cos— sin t + sm— cos 1 

6 6 6 6 y 


w(f) 


= e 


A 


5/3.55n 1 55tt 

— sm 1 + —cos 

v 2 6 2 6 j 


u(t ) 


^3 _in, . 55 7z 1 _io/ 55tt 
— e sin t + -e cos / 


w(C) 


Using Table D.4, we get 
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X 3 (s) = 




55tt 


5 + 10 


(.v + 10) 2 + 


55k V 
~ 6 ~ ) 


(.v + 10) 2 + 


55 k Y 

6 J 


5 + 


Re{^}>— 10 

55ttV3 


Re{j}>-10 


+ 10 


(.v + 10) 2 + 


55k Y 

6 J 


Re{5> > -10 


5 + 59.88 


Re{.v} > -10 


2 5 + 20.v + 929.3 

The Fourier transform of x 3 (7) exists since the imaginary axis lies in the ROC. 


X 3 {j(o) = ]~ 


jco + 59.88 


2 929.3 — a +20 jco 


Exercise 6.2 

For the causal LTI system H(s ) = , Re{.v} > -1 shown in Figure 6. 12, find the 

output responses Vi(t) and y 3 (t) to the input signals +,(/) and x 3 (t) ofExercise 6.1. 


X(s) 



Y(s) 

► 


FIGURE 6.12 Causal LTI system of 
Exercise 6.2. 


The Laplace transform of the output response y\(t) is given by 


Y l (s) = H(s)X 1 (s) 
-I5e~ 2s 

_ (5 + l) 2 (5-0.5)’ 


- 1 < Re{5> < 0.5 


A B C 
(5 + I ) 2 21+i ^-0.5 


Re{.s}>-1 


Re{^>>— 1 Re{s}<0.5 
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The coefficients are computed: 


Y 1 (s) = e 


-Is 


10 6.667 

(5 + 1) 2 

' -V- ' Re{s}>-1 


6.667 
5-0.5 ’ 

Re{s}<0.5 


and taking the inverse Laplace transform, we get 

y l ( t ) = 10(t — 2)e~ ( '~ 2 ] u(t — 2) + 6.667 e~ {t ~ 2 ’ u(t — 2) + 6.667 e°' 5{, ~ 2 ] u{—t + 2). 
The Laplace transform of the output response j 3 (t) is given by 
Y 3 (s) = H(s)X 3 (s) 

1 5 + 59.88 D r . . 

= ~ , Re{.v}>-1 

2 (5 + 1)(5 2 + 20.v + 929.3) 

A g(5 + 10) + 28.80C 
_ 5 + 1 , 5 2 + 20 5 + 929.3 

Re{s}>-I Re{s)>-10 

We find the coefficients by first multiplying on both sides by the common de- 
nominator and then by identifying the coefficients of the polynomials. 

5 + 59.88 = 2A(5 2 + 20 5 + 929.3) + 2[fl(5 + 10) + 28.80C](5 + 1) 

= 2 (A + B)s 2 + (40 A + 22 B + 57.6 C)s + 1858.6A + 20 B + 57.6C 

We obtain the linear vector equation: 


1 

1 

0 

" A 


0 

40 

22 

57.6 

B 

= 

1 

1858.6 20 

57.6 

C 


59.88 


'A" 


" 0.0323 " 

B 

= 

-0.0323 

C 


0.0073 


from which we compute 
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Thus, 


0.0323 -0.0323(5 + 10) + 28,8(0.0073) 

j + l , + . r + 20.v + 929.3 

Re{s>>-1 Re{s}>-10 

and taking the inverse Laplace transform, we get 
y 3 (t) = 0.0323 e~‘u(t) - 0.0323£> -10 ' cos(28.8/)w(f ) + 0.0073£> -10 ' sm(28.8/)«(/). 


Exercise 6.3 

Find all possible ROCs for the transfer function H (s) = (t 2 + 3tH | 3)(i _ 3) and give the 
corresponding impulse responses. Specify for each ROC whether the correspond- 
ing system is causal and stable. 

Answer: 

The complex poles are found by identifying the damping ratio C and undamped nat- 
ural frequency co„ of the second-order denominator factor with the standard sec- 
ond-order polynomial s 2 + 2 £co n + co 2 . Here co n = 75 , £ = ^ . Thus, the poles are 


Pi = 3 

- . r. 3 .75 

p 2 = -C®„ + 7®W 1 -C =--+j— 


P: = P: 


.75 


’ 2 ] ' 2 


There are three possible ROCs: Re{.v} <-1.5, - 1 .5 < Re{.v} < 3, Re{.v} > 3 . 
The partial fraction expansion of H(s) yields 


H(s) = 


1 


. 75 ' 

h J 

42 14 


1 


3 .73 

5-1 7 

2 2 


1 


.75 


42 14 


1 


1 1 


3 73 215-3' 

5-1 h 7 

2 2 


Using Table D.4 and simplifying, we find the following impulse responses: 
ROC 1 ={5eC:Re{5}>3} 


h(t) = 


.75' 


1- j — 

42 14 


e l-W*)Sht u{f) + 


. 75 ' 


42 14 


(-3/2-jj3/2)t 


u{t)-\ e 3 'u(t ) 

21 




TABLE 6.2 Impulse Responses in Exercise 6.3 for the Three Possible ROCs 



Exercises 

Exercise 6.4 

Compute the step response of the LTI system H(s) = 6(j+1) , Re{.v} > 0 . 

s(s + 3 ) 
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Exercise 6.5 

Compute the output y(t) of the LTI system H (s) = + 10Q , Re {a} > -5 for the 

input signal x(t) = e 4 'u(-t ) . 


Answer: 



ON THE CD 


Exercise 6.6 

2 

Suppose that the LTI system described by H(s ) = is known to be stable. 

Is this system causal? Compute its impulse response h(t). 

Exercise 6.7 

Consider an LTI system with transfer function H(s ) = * ~ 5 ; ; ~ ~ 6 ■ Sketch all possible 
regions of convergence of H(s) on pole-zero plots and compute the associated im- 
pulse responses h(t). Indicate for each impulse response whether it corresponds to 
a system that is causal/stable. 

Answer: 

ON THE CD 

Exercise 6.8 

Consider an LTI system with transfer function H(s ) = . Sketch all possi- 

S +yJ2s+l 

ble ROCs of H(s) on a pole-zero plot and compute the associated impulse re- 
sponses h{t). Indicate for each impulse response whether it corresponds to a system 
that is causal/stable. 

Exercise 6.9 

Suppose we know that the input of an LTI system is x(t) = e'u(—t ) . The output 
was measured to be y(t) = e~‘ sin(t)u(t) + e~ r u(t) + 2e r u(-t) . Find the transfer 
function H(s) of the system and its ROC and sketch its pole-zero plot. Is the sys- 
tem causal? Is it stable? Justify your answers. 


Answer: 
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Exercise 6.10 

3s 2 -3s- 6 

(a) Find the impulse response of the system H(s)= , 3 + i2 S 2 +i2o.s+2oo , 
Re fs } > - 2 . Flint: this system has a pole at - 2 . 

(b) Find the settling value of the step response of H(s) given in (a). 




Application of the 
Laplace Transform to 
LTI Differential Systems 


In This Chapter 

■ The Transfer Function of an LTI Differential System 

■ Block Diagram Realizations of LTI Differential Systems 

■ Analysis of LTI Differential Systems With Initial Conditions Using 
the Unilateral Laplace Transform 

■ Transient and Steady-State Responses of LTI Differential Systems 

■ Summary 

■ To Probe Further 

■ Exercises 


((Lecture 23: LTI Differential Systems and Rational Transfer Functions)) 

T he Laplace transform is a powerful tool to solve linear time-invariant (LTI) 
differential equations. We have used the Fourier transform for the same pur- 
pose, but the Laplace transform, whether bilateral or unilateral, is applicable 
in more cases, for example, to unstable systems or unbounded signals. 
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THE TRANSFER FUNCTION OF AN LTI DIFFERENTIAL SYSTEM 


We have seen that the transfer function of an LTI system is the Laplace transform 
of its impulse response. For a differential LTI system, the transfer function can be 
readily written by inspecting the differential equation, just like its frequency re- 
sponse can be obtained by inspection. 

Consider the general form of an LTI differential system: 


^ d k y(t) ^ , d k x(t) 

2A--t^ = 2A 


(7.1) 


We use the differentiation and linearity properties of the Laplace transform to 
obtain the transfer function H(s) = Y(s)/X(s) : 

N M 

Y,a k s k Y(s) = Y l b k s k X(s), (7.2) 

k = 0 k = 0 


H(s) = 


Y(s) 

X(s) 




(7.3) 


Note that we have not specified a region of convergence (ROC) yet. This 
means that differential Equation 7.1 can have many different impulse responses; 
that is, it is not a complete specification of the LTI system. If we know that the dif- 
ferential system is causal, then the ROC is the open right half-plane to the right of 
the rightmost pole in the 5-plane. The impulse response is then uniquely defined. 


Poles and Zeros of the Transfer Function 

Let n{s) := XTo b k s k be the numerator polynomial of the transfer function H(s) in 
Equation 7.3 and let d(s) := <^.5* be its denominator polynomial. Then, 

■ The poles of H(s) are the N roots of the characteristic equation d(s) = 0 , or, 
equivalently, the N zeros of the characteristic polynomial. 

■ The zeros of H(s) are the M roots of equation n(s) = 0 . 

■ If M > N, then lim H(s) = °°, and the transfer function is sometimes said to 

have M-N poles at 00 . 

■ If M <N, then lim//(5) = 0, and the transfer function is sometimes said to 
have N-M zeros at °°. 
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Example 7.1: Find the transfer function poles of the following causal differen- 

tial LTI system. 



Taking the Laplace transform on both sides, we get 

s 2 Y(s) + (O c ^sY(s) + co 2 Y{s) = s 2 X(s ) + (O c V 2 sX(s), (7.5) 


which yields 

Y(s) s 2 + co V 2 s 

H (s) = -^- = ~ f -• (7.6) 

X(s) S 2 +(D 'J2s+(D 2 

c c 

The poles are the roots of s 2 + co yfls + or = 0 (note that this is the second- 
order Butterworth characteristic polynomial). Identifying the coefficients with the 
standard second-order denominator s 2 + 2Co) n s + co 2 t , one finds the damping ratio 
C = V 2/2 = 0.707 and the undamped natural frequency (O n =CO c . The poles of 
H(s) are then given by the following formulas: 


r /Ti T ^2 . V 2 

-1 =-—(O c + j—(O c = (O c e 4 , 

1 \F? - ite 

Pi =-&„-a„\IC 2 -1 = — Y 0) c~j^f (0 c = (0 X 4 ( 7 - 7 ) 


and its two zeros are 

Zj =-CO ( yj2, z 2 = 0. (7.8) 

The poles and zeros of a transfer function are usually denoted with the symbols 
X and O, respectively, in the .v- plane, as shown in Figure 7.1, which is the pole-zero 
plot of H(s). 

Causality 

The transfer function of an LTI system by itself does not determine whether the 
system is causal or not. We have seen that for rational Laplace transforms, causal- 
ity is equivalent to the ROC being an open right half-plane (open means that the 
half-plane’s boundary is not included) to the right of the rightmost pole. Lienee, 
since differential LTI systems considered in this section have rational transforms, 
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the LTI differential system of Equation 7.1 is causal if and only if the ROC of its 
transfer function is an open right half-plane located to the right of the rightmost 
pole. 



FIGURE 7.1 Pole-zero plot of transfer function in 
Example 7.1. 


We normally deal with causal differential systems, as analog engineering sys- 
tems are naturally causal. 

BIBO Stability 

The stability of an LTI differential system is directly related to the poles of the 
transfer function and its region of convergence. Recall that an LTI system (includ- 
ing a differential LTI system) is stable if and only if the ROC of its transfer func- 
tion includes the yen-axis. Assume there is no pole-zero cancellation in the closed 
right half-plane when H(s) = n(s)/d(s) is formed. Then, a causal LTI differential 
system is stable if and only if the poles of its transfer function all lie in the open left 
half-plane. 

Remark: It is customary to refer to the set {.v : Re{.v} > 0} as the right half- 

plane (or to {.v : Refs} > 0} as the open right half-plane) and to (.s' : Re fs} < 0} as 
the left half-plane (or to {.s : Re{.v} < 0} as the open left half-plane). 

Recall that for the case where a zero cancels out an unstable pole (call it p 0 ) in 
the transfer function, the corresponding differential LTI system is considered to be 
unstable. The reason is that any nonzero initial condition would cause the output 
to either grow unbounded (case Re{y> 0 } > 0 ), oscillate forever (case p 0 imaginary), 
or settle down to a nonzero value (case p 0 = 0). 
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In Example 7.1, the two complex conjugate poles are in the open left half- 
plane, so the system is stable. 

Example: System Identification 

Suppose we know that the input of the differential LTI system depicted in Figure 
7.2 is x(t) = 2e~‘ u(t) . 


x(t) 


► 


H(s) 


At) 

-> 


FIGURE 7.2 Finding the transfer function of an 
LTI system. 


If the output was measured to be y(t) = e~ 2 ' sin(2t)u(t) - te~' u(t) , let us find 
the transfer function H(s ) of the system and its ROC and sketch its pole-zero plot. 
Let us also determine whether the system is causal and stable. This is known as 
system identification, studied here in its simplest, noise-free form. 

First, let us take the Laplace transforms of the input and output signals using 
Table D.4 in Appendix D: 


X(s) = —^—, Re{.v}>-1 
5 + 1 


(7.9) 


Y(s) = 


2 1 

0 + 2) 2 + 2 2 ~ (.v + 1) 2 


Re{.s}>— 2 


Re{s}>-1 


(2r + 45 + 2)-(r +4.V + 8) 

(r + 4 .v + 8)(5 + 1) 2 

2 — ft 

j, Re{s}>-1. 

(s 2 + 4.v + 8)(.v + 1) 2 


, Re{.v} > -1 


Then, the transfer function is simply 

s 2 -6 

Y{s) (s 2 + 4.v + 8)(.v + l) 2 (5-V6)(5 + V6) 


H(s) = 


X(s) 


2(5 2 + 4.v + 8)0 + 1) 


(7.10) 


(7.11) 


0 + 1 ) 
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To determine the ROC, first note that the ROC of Y(s ) should contain the in- 
tersection of the ROCs of H(s) and X(s). There are three possible ROCs for H(s): 

ROC, : an open left half-plane to the left of Refs} = -2 

ROC 2 : an open right half-plane to the right of Rc{.v| = -1 

ROC 3 : a vertical strip between Refs} = -2 and Re{s} = -1 

Since the ROC ofX(s) is an open right half-plane to the right of Re{s} = -1 , the 
only possible choice is ROC 2 . Hence, the ROC of H(s ) is {seC: Re{s} > -l}. 

The system is causal, as the transfer function is rational and the ROC is a right 
half-plane. It is also stable, as the transfer function is proper and all three poles 
p l2 =-2± j 2, p 3 = -1 are in the open left half-plane, as shown in Figure 7.3. 



FIGURE 7.3 Pole-zero plot of identified 
transfer function. 


A causal LTI differential equation representing the system is obtained by in- 
spection of the transfer function: 


2 ^ + ,0 LM + 24 ^> + 1 6 *,) = Df _ Sx(l). (7.12) 


dr' 


dr 


dt 


dr 



((Lecture 24: Analysis of LTI Differential Systems with Block Diagrams)) 


BLOCK DIAGRAM REALIZATIONS OF 
LTI DIFFERENTIAL SYSTEMS 


Block diagrams are useful to analyze LTI differential systems composed of sub- 
systems. They are also used to represent a realization of an LTI differential system 
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as a combination of three basic elements: the integrator, the gain, and the summing 
junction. 

System Interconnections 

We have already studied system interconnections using block diagrams in the con- 
text of general systems (not necessarily linear) and also in the context of LTI sys- 
tems with the convolution property and Fourier transforms. However, this 
approach to analyzing complex systems becomes quite powerful when one uses 
transfer functions to describe the interconnected LTI systems. The reason is that the 
space of all transfer functions forms an algebra with the usual arithmetic opera- 
tions (+,-,x,/). That is, the sum, difference, multiplication, or division of two trans- 
fer functions yield another transfer function. 

Example 7.2: Find the step response of the car cruise control system depicted in 

Figure 7.4 to a step in the desired velocity input v des from 0 km/h to 1 00 km/h, where 

P(s )= — - — , Re{s}>-3 
5 + 3 

*($) = —, Re{s} > 0 
s 

F(s) = 2, Vs g C (7.13) 

and the time unit is the minute. 



FIGURE 7.4 Block diagram of a car cruise control system. 


This feedback system represents a car cruise control system where P(s) is the 
car’s dynamics from the engine throttle input to the speed output, F(s ) is a scaling 
factor on the tachometer speed measurement to get, for example, kilometer per 
hour units, and K(s) is the controller, here a pure integrator that integrates the error 
between the desired speed and the actual car speed to obtain a throttle command 
u(t) for the engine. 
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It is interesting to note that the theory of Laplace transforms and transfer func- 
tions allows us to analyze within a single framework a mechanical system (the car), 
an electromechanical sensor (the tachometer), and a control circuit or a control al- 
gorithm residing in a microcontroller chip. 

The first task of a control engineer would be to check that this system is stable. 
We do not want the car to accelerate out of control when the driver switches the 
cruise control system on. Thus, we need to find the transfer function relating the 
input v des (t) to the scaled measured speed of the car v(1) and compute its poles. Let 
us denote the Laplace transforms of the signals with “hats.” We have 

v(s) = F(s)P(s)K(s)e(s) 

e( s ) = v de M)-K'<)- 

Thus, the error can be expressed as 


Ks) = v des (s)- F(s)P(s)K(s)e(s) 

= v, (s). 

1 + F(s)P(s)K(s) des 


(7.15) 


and substituting this expression back into the first equation of Equation 7.14, we 
obtain 


v(s) = 


F(s)P(s)K(s ) 

1 + F(s)P(s)K(s) 


= H(s)v,(s). 


H(s) 


(7.16) 


This is the transfer function relating the desired car velocity to its measure- 
ment. Using the actual transfer functions provided above, we get 


H(s) = 


9 l ip 

s+3 s 


1 + 2 ^ 

5+3 s 


20 

s 2 + 3s + 20 


(7.17) 


This is a second-order transfer function with undamped natural frequency 

(O n = V20 rad/min and damping ratio f = 0.34 . Hence, the poles are in the 

open left-half plane: 

A - V? 3 ! =-1.5 + y4.2131 

p 2 = -C©„ - co n ^i = -1.5- 74.2131, 


(7.18) 
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which means that the system is stable and the ROC of H(s) is Rc{.v) > —1.5. The 
Laplace transform of the car speed response to a step in the desired velocity input 
v des from 0 km/h to 1 00 km/h is 


v(s) = H(s)v d Js) 

20 100 
s~ + 3s + 20 s 


Re {s} > 0 


A(s + \.5)+ BA2\2>\ C 

(s + 1.5) 2 + (4.213 1) 2 £ ’ 

Re{s}>-1.5 Reis!>0 


(7.19) 


where the second-order term of the partial fraction expansion was written to match 
the form of the Laplace transform of the sum of a damped sine and cosine (see 
Table D.4). We find 


- -100(s + 1.5) -35.603(4.2 131) 100 

' ' / . -t /-\ 7. . s a +'>+ \ *). 5 

o 


(7.20) 


(s + 1.5) 2 +(4.2131) 2 
which, for the ROCs of Equation 7.19 and using the table, corresponds to 

v(t ) — [lOO - lOOe' 1 ' 5 ' cos4.213fr - 35.603W 1 ' 5 ' sin4.213fr] M (0 km/h (7.21) 
This speed response is shown in Figure 7.5. 
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It can be seen on this plot that there is too much overshoot in the speed re- 
sponse. By choosing a smaller integrator gain in K(s), we would obtain a smoother 
response with less overshoot. This is a problem typical to the area of control engi- 
neering introduced in Chapter 11. 

Realization of a Transfer Function 

It is possible to obtain a realization of the transfer function of an LTI differential 
system as a combination of three basic elements shown in Figure 7.6: the integra- 
tor, the gain, and the summing junction. 



integrator gain summing junction 

FIGURE 7.6 Basic elements to realize any transfer function. 


Simple First-Order Transfer Function 

Consider the transfer function H(s) = — . It can be realized with a feedback in- 

V 7 s + a 

terconnection of the three basic elements, as shown in Figure 7.7. 



FIGURE 7.7 Realization of first-order transfer function. 


The feedback equation associated with this block diagram is as follows: 

Y(s) = -a-7(s) + -X(s) 
s s 

1 1 

= -^ T X(s) = 

1+fly S+fl 


X(s) = H(s)X(s). 


(7.22) 
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With this simple block diagram, we can realize any transfer function of any 
order after it is written as a partial fraction expansion. This leads to the parallel 
form introduced below. 

Simple Second-Order Transfer Function 

Consider the transfer function H(s ) = 2 — 1 . It can be realized with a feedback 

s +& l $+a 0 

interconnection of the three basic elements in a number of ways. One way is to ex- 
pand the transfer function as a sum of two first-order transfer functions (partial 
fraction expansion). The resulting form is called the parallel form and is discussed 
below. Another way is to break up the transfer function as a cascade (multiplica- 
tion) of two first-order transfer functions. This cascade form is also discussed 
below. Yet another way to realize the second-order transfer function is the so- 
called direct form or controllable canonical form. To develop this form, consider 
the system equation 

s 2 T(s) = -a x sY(s) - a 0 Y(s) + X(s). (7.23) 

This equation can be realized as in Figure 7.8. The idea is that the variable at 
the input of an integrator is thought of as the derivative of its output. 



FIGURE 7.8 Direct form realization of a second-order transfer 
function. 


Parallel Realization 

A parallel realization can be obtained by expanding the transfer function into 
partial first-order fractions with real coefficients or complex coefficients for com- 
plex poles. 

Example 7.3: Consider the system H(s) = + -X. Its parallel re- 

alization is shown in Figure 7.9. 
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FIGURE 7.9 Parallel realization of a second-order 
transfer function. 


Cascade Realization 

A cascade realization can be obtained by expressing the numerator and denomina- 
tor of the transfer function as a product of zeros of the form (s — z.) and of poles 
of the form (s — p.), respectively, and by arbitrarily grouping a pole with a zero 
until all zeros are matched to form first-order subsystems. The poles left at the end 
of this procedure are taken as first-order subsystems with constant numerators. 

Example 7.4: Consider the system H(s) = (;+ ~ 1)(; _ 0) . Its cascade form is shown 

in Figure 7.10 for the grouping H(s ) = ^ j| Til j . The zero in the first first-order 

subsystem is implemented using a feedthrough term. This first subsystem is actu- 
ally realized in a direct form, which is explained next. 



FIGURE 7.10 Cascade realization of a second-order transfer function. 
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Direct Form (Controllable Canonical Form) 

The direct form, also called the controllable canonical form, can be obtained by 
breaking up a general transfer function into two subsystems as in Figure 7.11. 



FIGURE 7.1 1 Transfer function as a cascade of two LTI subsystems. 


The input-output system equation of the first subsystem is 

s N W(s) = -a N _/~ l W{s) apWis) - a 0 W(s ) + X(s), (7.24) 

and for the second subsystem, we have 

T (.S’) = b M s M W(s) + b Ml s M ~ l W(s) + • ■ ■ + b x sW(s) + b 0 W(s). (7.25) 

To get the direct form realization, a cascade of N integrators is first sketched, 
and the input to the first integrator is labeled s N W ( s ) . The output of this first inte- 
grator is s N W ( s ) = s N ~'W ( s ) . The outputs of the remaining integrators are 

labeled successively from the left: .v v_2 H / (.v), etc. Then, the feedback paths with 
gains equal to the coefficients of the denominator as expressed in Equation 7.24 are 
added. Finally, Equation 7.25 is implemented by tapping the signals s k W (s ) , multi- 
plying them with coefficients of the numerator of the transfer function, and summing 
them. Figure 7.12 shows a direct form realization of a second-order transfer function. 



FIGURE 7.12 Direct form realization of a second-order transfer function 
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((Lecture 25: Response ofLTI Differential Systems with Initial Conditions)) 


ANALYSIS OF LTI DIFFERENTIAL SYSTEMS WITH INITIAL 
CONDITIONS USING THE UNILATERAL LAPLACE TRANSFORM 


Recall the differentiation property of the unilateral Laplace transform: 


UL 


If x(t)<->T(s)> se ROC, then 


dx(t) ul 

0”), s e ROCj □ ROC. 


(7.26) 


We have already solved a first-order system with an initial condition. Let us 
now look at a second-order LTI differential system with initial conditions and a 
nonzero input. 

Example 7.5: Consider the causal second-order system described by 


d 2 y(t) ~dv(t) . dx(t ) . . . 

- ; ; + 3^2-2 + 2 y(t) = + 3x(t) 


dr 


dt 


dt 


(7.27) 


and with initial conditions dvi ^ - = 2, y{ 0 ) = 1 . Suppose that this system is sub- 
jected to the input signal: 


x(t) = e 5, u(t). 


(7.28) 


What is the output of the system? Take the unilateral Laplace transform on 
both sides of Equation 7.27. 


5 ty{s)-sy { 0 ) — 

dt 


■ 3[s^(s)-y(0 )] + 2^(s) = 5^(s)-x(0 )+3 %(s) (7.29) 


Note that x(0 ) = 0. Collecting the terms containing 1jf(s) on the left-hand side 
and putting everything else on the right-hand side, we can solve for^(s). 


(s 2 + 3s + 2j^(s) = + 3)T(s) + sy(0 ) + 3y(0 )- 

( J+ 3)*W v(0-)+3y(0-) + fD 


dy( 0 ) 
dt 


W) = 


s~ + 3s + 2 


s 2 + 3s + 2 


(7.30) 
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We have, 


and thus. 


20) = —*—, Re{s}>-5, 
5 + 5 


(7.31) 


%(s) = 


5+3 


[s 2 + 3s + 2)(s + 5) s 2 + 3s + 2 
s 2 + 115 + 28 


5 + 5 „ r , 

+ — ; — : -, Re{5}>-1 


^ 5 2 +35 + 2^5 + 5 ) 


, Re{5} > -1 


10 

3 


5+1 5+2 5+5 

Taking the inverse Laplace transform of each term, we obtain 


(7.32) 


y(t) = 


9 10 _ 2 , 1 _ 5( 

— e e e 

2 3 6 


u(t). 


(7.33) 


Zero-Input Response and Zero-State Response 

The response of a causal LTI differential system with initial conditions and a 
nonzero input can be decomposed as the sum of a zero-input response and a zero- 
state response. As these names imply, the zero-input response is due to the initial 
conditions only, whereas the zero-state response is produced by the input only. 
Note that the term state refers to the initial state in a state-space description of a dif- 
ferential system. We will study state-space systems in Chapter 10. 

In Example 7.5, the zero-input and zero-state responses in the Laplace domain 
are identified as follows. 


ty(s) = 


(.v + 3)T(5) 
5 2 + 35 + 2 


5y(0-) + 3y(0-) + ^^ 
at 

K 5 2 + 35 + 2 


(7.34) 


zero-state resp. 


zero-input resp. 
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TRANSIENT AND STEADY-STATE RESPONSES OF 
LTI DIFFERENTIAL SYSTEMS 


The transient response (also called natural response) of a causal, stable LTI dif- 
ferential system is the homogeneous response. 

The steady-state response (or forced response) is the particular solution corre- 
sponding to a constant or periodic input. We say that a stable system is in steady- 
state when the transient component of the output has practically disappeared. For 
example, consider the step response 

s(t) = u(t) - e~ 5 'u(t). (7.35) 

The transient part of this response is the term e~ 5 'u(t), and the steady-state part 
is u(t). 

As another example, assume that a causal LTI differential system is subjected to 
the sinusoidal input signal x(t) = sin (to t)u(t). Suppose that the resulting output is 

y(t) = 2sin (m 0 t — <p)u(t) + e~ 2 ' cos (2t + 0)u(t). (7.36) 

Then the transient response of the system to the input is e~ 2 ' cos(2 1 + O)u( t), 
while 2sin (co 0 t - (p)u(t) is the steady-state response. 

The steady-state response of a causal, stable LTI system to a sinusoidal input 
of frequency (O 0 is also a sinusoid of frequency co 0 , although in general with a dif- 
ferent amplitude and phase. 

Transient and Steady-State Analysis Using the Laplace Transform 

For a causal, stable LTI system with a real-rational transfer function, a partial frac- 
tion expansion of the transfer function allows us to determine which terms corre- 
spond to transients (the terms with the system poles) and which correspond to the 
steady-state response (terms with the input poles). 


Example 7.6: Consider the step response. 

5 + 3 


Y(s) = 


^ + 3s + 2 ) 
5 + 3 


X(s), Re{.v} > -1 
, Re{5}>0 


(s 2 +35 + 2^5 

ABC 

: + + 

5+1 5+2 ^ 

Re{.i}>— 1 Re{s}>-2 Re{s}>0 


(7.37) 




Application of the Laplace Transform to LTI Differential Systems 275 


The steady-state response corresponds to the last term, C, which in the time- 
domain is Cu(t). The other two terms correspond to the transient response 
Ae~'u(t) + Be~ 2 'u(t) . 

If we are only interested in the steady-state response of an LTI system, there is 
no need to do a partial fraction expansion. The transfer function and the frequency 
response of the system (which is the transfer function evaluated at s =jCQ ) directly 
give us the answer. 

Step Response 

We can use the final value theorem to determine the steady-state component of a 
step response. In general, this component is a step function Au(t). The “gain” A is 
given by 


A = limsT/ls)- = H{0) (7.38) 

*->o s 

Response to a Sinusoid or a Periodic Complex Exponential 

The frequency response of the system directly gives us the steady-state response to 
a sinusoid or a periodic complex exponential signal. For the latter, x(t) = Ae'" v , 
the steady-state response is 

y ss (t) = H(jco 0 )Ae J(O °‘ 

= \H(j(O 0 )\Ae i% ' +ZH(JWa)) . (7.39) 

For a sinusoidal input, say x(t) = Hsin(co 0 t), the steady-state response is as fol- 
lows (the same for a cosine signal): 

yjt) = ^ (H(jco 0 )e - H(-jaj 0 )e-»*) 

= —(\H(j(oJe K(0o ' +ZH(JWo)) - \H{-jco Q )\e- i( ^- ZH( - 1 ^ )) ) 

2 j 

= —(\H(jco 0 )\e Kco °' +ZH<jcOo)) - \H(jco 0 )\e- J<COo,+ZHUWo>) ) 

2 j 

= \H(jco 0 )\Asm(co 0 t + ZH(jco 0 )), (7.40) 

where we used the fact that the frequency response magnitude is even and the phase 
is odd for a real-rational transfer function. An important application is the steady- 
state analysis of circuits at a fixed frequency, for instance, 60 Hz. For example, if a 
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circuit is described by its impedance, Z(s), seen as a transfer function, then its 
steady-state response to a 60 Hz sinusoidal current is characterized by the complex 
number Z( j 2tt60). 

Response to a Periodic Signal 

Again, the frequency response of the system gives us the steady-state response to 

^ ^ + °° 

a periodic signal admitting a Fourier series representation. For x{t) = X a k e jk< ° 0 ', 
the steady-state response is the periodic signal: 


yjt) = X H(jkco 0 )a k e jko>0> . (7.41) 

k=-oo 


SUMMARY 


In this chapter, we studied the application of the Laplace transform to differential 

systems. 

■ The transfer function of an LTI differential system can be obtained by inspec- 
tion of the differential equation. 

■ The zeros and poles of a transfer function were defined as the zeros of its nu- 
merator and denominator, respectively. 

■ Transfer functions can be interconnected in block diagrams to form more com- 
plex systems whose transfer functions can be obtained using simple rules. 

■ Any proper real-rational transfer function can be realized using an intercon- 
nection of three basic elements: the gain, the summing junction, and the inte- 
grator. We discussed the parallel, cascade, and direct form realizations. 

■ The unilateral Laplace transform can be used to compute the response of a dif- 
ferential system with initial conditions. The overall response is composed of a 
zero-state response coming from the input only (assuming zero initial condi- 
tions) and of a zero-input response caused by the initial conditions only. An- 
other way to decompose the overall response of the system is to identify the 
transient response and the steady-state response. 


TO PROBE FURTHER 


On the response of LTI differential systems, see, for example, Oppenheim, Will- 
sky, and Nawab, 1997. We will revisit realization theory in the context of state- 
space systems in Chapter 10. 
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EXERCISES 


Exercises with Solutions 

Exercise 7.1 

Consider the system described by 


H(s) = 


3 s 2 — 3s — 6 

s 3 + 12s 2 +120^ + 200’ 


Re{.v} > -2. 


(a) Find the direct form realization of the transfer function H(s). Is this system 
BIBO stable? Is it causal? Why? 


Answer: 

The direct form realization is obtained by splitting up the system into two systems 
as in Figure 7.13. 



FIGURE 7.13 Transfer function split up as a cascade of two subsystems, 
Exercise 7.1 (a). 


The input-output system equation of the first subsystem is 

s 3 W(s) = -12rWO) - 12(W(s)- 200W(s) + X(s), 

and we begin the diagram by drawing a cascade of three integrators with their in- 
puts labeled as s 3 fV(s), s 2 W(s), sW(s). Then, we can draw the feedbacks to a 
summing junction whose output is the input of the first integrator, labeled s 3 W (5) . 
The input signal is also an input to that summing junction. For the second subsys- 
tem we have 


Y(s) = 3 s 2 W(s)-3sW(s)-6W(s), 

which can be drawn as taps on the integrator inputs, summed up to form the output 
signal. The resulting direct form realization is shown in Figure 7.14. 
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FIGURE 7.14 Direct form realization of transfer function, Exercise 7.1 (a). 


The system is BIBO stable, as its rational transfer function is proper and its 
ROC contains the yen-axis. It is also causal because its ROC is an open right-half 
plane and its transfer function is rational. 

(b) Give a parallel form realization of H(s) with (possibly complex-rational) 
first-order blocks. 


Answer: 

The partial fraction expansion for the parallel realization of the transfer function is 
as follows. Figure 7.15 shows the corresponding parallel realization. 


H(s) = 


3s 2 -3s-6 

s 3 + 12s 2 + 120^ + 200’ 


3s 2 — 3^ — 6 
0 + 2)0r +105 + 100)’ 


Re{5> > -2 


Re{.v} > -2 


0.14286 1 .4286 + yl .4104 1.4286- yl. 4104 

1 1 

, 5 + 2 5 + 5-y'5x/3 s + 5 + j5y/3 

Re{j}>-2 ' r2{j}>75 ' ' Re{U>— 5 


(c) Give a parallel form realization of H(s ) using a real-rational first-order 
block and a real-rational second-order block. 


Answer: 

The transfer function can be expanded as follows: 


H(s) = 


0.14286 


- + 


2.8575-10.14287 
5 2 + 105 + 100 ’ 


5 + 2 

Re{5}>— 2 


Re{^}>-5 
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FIGURE 7.1 5 Parallel form realization of transfer function in 
Exercise 7.1 (b). 


which corresponds to the desired parallel realization in Figure 7.16. 



FIGURE 7.16 Real-rational parallel form realization of transfer function in 
Exercise 7.1 (c). 
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Exercise 7.2 

Consider the causal differential system described by 


d 2 y(t ) | 3 dy(t) 
dt 2 dt 


+ 25 y(t) = 


d 2 x(t ) 
dt 2 


dx{t) 

dt 


+ x(t), 


with initial conditions 2LT2 = 3, y(0 ) = -1. Suppose this system is subjected to 
a unit step input signal x(f) = ii(t) . 

Find the system’s damping ratio C, and undamped natural frequency ( 0 „. Give 
the transfer function of the system and specify its ROC. Compute the steady-state 
response y ss (t) and the transient response y„.(0 for t > 0. Compute the zero-input re- 
sponse y zi (t) and the zero-state response y~ s {t). 


Answer: 

Let us take the unilateral Laplace transform on both sides of the differential equation. 


s 2 %(s)-sy ( 0 )~ dy( \ ^ 
dt 


■ 3[.v^O)-y(0 )] + 25^0) = s 2, %(s)-s%(s)+%(s) 


Collecting the terms containing tyis) on the left-hand side and putting every- 
thing else on the right-hand side, we can solve for^(.v). 


(s 2 + 35 + 25 )”^(s) = s 2, Z(s)— s‘Z(s)+‘Z(s)+ sy(0 ) + 3y(0 ) 


+ 


dy(0~) 

dt 


ty(s) = 


(s 2 -s+m(s) + {s+3)y{0 ~ )+ 


dy(0~) 

dt 


s + 3 s ~\~ 25 


zero-state resp. 


s + 3s 1 + 25 


zero-input resp. 


The transfer function is H(s)= , and since the system is causal, the 

ROC is an open right half-plane to the right of the rightmost pole. The poles are 
p l2 =-1.5+ /'4.77. Therefore, the ROC is Re{.v} >-1.5. The unilateral Laplace 
transform of the input is given by 


%(s) = 


1 

s 


Re{.v} >0, 
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and thus, 


%(s) = 


s 2 -s + 1 


- + - 


-5 


5(5 2 + 35 + 25) 5 2 + 3.s + 25 


zero-state resp. 

-5 + 1 


zero-input resp. 


s(s 2 + 3s + 25) 

Let us compute the zero-state response first: 




S 2 — 5 + 1 
5(5 2 + 35 + 25) 


, Re{5> > 0 


A(4.77) + g(5 + 1.5) C 

(5 + 1.5) 2 +22.75 £ 

v v ' Re{^}>0 

Re{.?}>— 1.5 

A(4.77) + fi(5 + 1.5) 004 

5 

' Re{s}>0 


(5 + 1.5)" +22.75 


Re{s}>-1.5 


T . , c , . (-1.5) 2 + 1.5 + 1 

Let 5 = -1.5 to compute — - 


4.77 


A - 0.0267 => A = -0.5365 , then 


(-1.5X22.75) 22.75 

multiply both sides by 5 and let 5 — > °o to get 1 = B + 0.04 => B = 0.96 : 

-0.5365(4.77) + 0.96(5 + 1.5) 0.04 
— : ~ ■" 


(5 + 1 . 5 )" +22.75 


Re{.?}>— 1.5 


0.04 


5 

Re{s}>0 


Notice that the second term, — , is the steady-state response, and thus, 
yJt) = ()Mu(t). 

Taking the inverse Laplace transform using Table D.4, we obtain 


y, 


,(/) = [-0.5365c’" 1 ' 5 ' sin(4.77f) + 0.96c’" 1 ' 5 ' cos(4.77f )]«(/) + 0.04w(/). 


Let us compute the zero-input response: 

-5 


5 2 + 35 + 25 


, Re{.v} > —1.5 


1.5 

4.77 


(4.77)-(5 + 1.5) 


( 5 + 1.5)" +22.75 


Re{.v} > —1.5 
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The inverse Laplace transform using the table yields 

y zi (t) = [0.3145L 1 ' 5 ' sin(4.77f)- e~ 1J ‘ cos(4.77/)]«(/). 

Finally, the transient response is the sum of the zero-input and zero-state re- 
sponses minus the steady-state response. 

y„(t) = [(0.3 145 - 0.5365)e“ 15 ' sin(4.77f ) + (0.96 - l)e~ h5 ' cos(4.77r)] w(0 
= [-0.222U 1 ' 5 ' sin(4.77t)-0.04e“ 1 ' 5 ' cos(4.77r)]w(0- 


Exercises 

Exercise 7.3 

Consider the causal differential system described by 


1 d 2 y(t) 
4 dt 2 


+ 


1 dy(t) 
dt 


+ y(t) = 


dx{t) 

dt 


+ x(t), 


with initial conditions = 3, y(0 ) = 0 h'- Suppose that this system is sub- 
jected to the input signal, x(t) = e~ 2 'u(t ) . Find the system’s damping ratio C, and 
undamped natural frequency co, r Compute the output of the system y(t) for t> 0 . 
Find the steady-state response y ss (t), the transient response y tr (t), the zero-input 
response y zl (t), and the zero-state response y :s (t) for t> 0 . 


Answer: 



ON THE CD 


Exercise 7.4 


Use the unilateral Laplace transform to compute the output response y{t) to the 
input x(t) = cos(10f)zi(f) of the following causal LTI differential system with ini- 
tial conditions y(0“) = 1, = 1 : 


d 2 y(t) 
dt 2 


+ 5 


dy{t) 

dt 


+ 6 y(t) = x(t). 


Exercise 7.5 

Compute the steady-state response of the causal LTI differential system 5 —yy + 
y(t) = 10x(f) to the input x(t) = sin(20f) . 
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Answer: 

J ) 

ON THE CD 

Exercise 7.6 

s 2 — ?>s + \2 

(a) Find the direct form realization of the transfer function H(s) = 3 ^ +9j+ " , 
Re{.v} > -1 . Is this system BIBO stable? Is it causal? Why? Let y(t) be the 
step response of the system. Compute y(0 + ) and y(+°° ) . 

(b) Give a parallel form realization of H(s) given in (a) with first-order blocks. 

Exercise 7.7 

(a) Find the direct form realization of the following transfer function. Is this 
system BIBO stable? Is it causal? Why? 

v“ 4- 4 v — 6 

H(s ) = 3 ‘ - 1 < ReW < 2 

s 3 + 2 s 2 -5s-6 

(b) Give a parallel form realization of H(s) with first-order blocks. 

(c) Give a cascade form realization of H(s) with first-order blocks. 


Answer: 



ON THE CD 


Exercise 7.8 

Consider the causal differential system described by 


1 d 2 y{t) 

2 dt 2 


+ 


dy(t) 

dt 


+ 2 y(t) = 


dx{t) 

dt 


x(t), 


with initial conditions ^ ’ = 1, y(0 ) = 2. Suppose this system is subjected to 
the input signal x(t) = u{t ) . Give the transfer function of the system and specify its 
ROC. Compute the steady-state response y ss (t) and the transient response y„ (t) 
for t > 0 . 
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((Lecture 26: Qualitative Evaluation of the Frequency Response from the 
Zero Plot)) 


Pole- 


I n this chapter, we will analyze the behavior of stable continuous-time linear 
time-invariant (LTI) systems by looking at both the time-domain and the fre- 
quency-domain points of view. We will see how to get a feel for the frequency 
response of a system by looking at its transfer function in pole-zero form. We will 
also introduce the Bode plot, which is a representation of the frequency response 
of a system that can be sketched by hand. 
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RELATION OF POLES AND ZEROS OF THE TRANSFER FUNCTION 
TO THE FREQUENCY RESPONSE 


A standing assumption here is that the causal LTI system is stable. This means that 
all the poles of the transfer function lie in the open left half-plane. On the other 
hand, the zeros do not have this restriction. 

We want to be able to characterize qualitatively the system’s frequency re- 
sponse from the knowledge of the poles and zeros of the transfer function. Consider 
a transfer function written in its pole-zero form: 


H(s) = 


Kjs-zJ—js-Zx) 

(s-Pi)—(s-P N ) 


( 8 . 1 ) 


When we let s = jco, each first-order pole and zero factor can be seen as a vector 
whose origin is at the pole (zero) and whose endpoint is at jco. For a fixed frequency 
CO, each of these vectors adds a phase contribution and a magnitude factor to the 
overall frequency response. Let us illustrate this by means of two examples. 

Example 8.1: A stable first-order system with transfer function 

H(s) = -^— ,Re{.v}>-2 (8.2) 

s + 2 


has the frequency response 


H(jco) = — — — ■ (8.3) 

jco + 2 

In the .v-planc, the complex denominator 2 + jco can be seen as a vector-valued 
function of CO, with the vector’s origin at the pole and its endpoint at jco on the 
imaginary axis, as depicted in Figure 8.1 for co = -1,0,1 rad/s. 

Thus, as co goes from to 0 rad/s, the magnitude of 2 + jco (the vector’s 
length) goes from °° to 2, while its phase goes from -n/2 to 0 rad. This in turn im- 
plies that the magnitude of H( jco) = (2 + jco)~ l varies from 0 to 0.5, while its 
phase goes from n/2 to 0 rad. 

Then, as ft) goes from 0 to °° rad/s, the magnitude of 2 + /ft) (the vector’s length) 
goes from 2 to °°, while its phase goes from 0 to n/2 rad. This implies that the mag- 
nitude of H( jco) = (2 + /ft)) 1 varies from 0.5 to 0, while its phase goes from 0 to 
-n/2 rad. Using this information, we can roughly sketch the magnitude and phase 
of the frequency response as shown in Figure 8.2. 
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FIGURE 8.1 Denominator jco + 2 seen as a vector- 
valued function of frequency in the complex plane. 



FIGURE 8.2 Sketch of the frequency 
response of l/(s + 2). 


Of course, for this simple example we know that 




1 

jco + 2 



j arctanj 

e 



(8.4) 


For a higher-order system, the vector representation of each first-order pole 
and zero factor can help us visualize its contribution to the overall frequency re- 
sponse of the system. 
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Example 8.2: A stable third-order system with transfer function 


H(s) = 


(s + l)(s-2) 


(. s + 3)0 + V2 - jV2)0 + V2 + y V2) 
has the frequency response 

O'® + 1)0'® -2) 


, Re-0} > -V2 


(8.5) 


# 0 '®) = 


O'® + 3)(ycy + V2 - j\f2)(jco + V2 + 7V2 ) 


(8.6) 


In the 5-plane, the vector-valued functions of cn originating at the poles and 
zeros are depicted in Figure 8.3. 



FIGURE 8.3 Vector representation of the 
first-order terms in the pole-zero form of the 
transfer function. 


The phase at frequency CO is given by the sum of the angles of the vectors origi- 
nating at the zeros minus the sum of the angles of the vectors originating at the poles. 

The magnitude at frequency co is given by the product of the lengths of the vec- 
tors originating at the zeros divided by the product of the lengths of the vectors 
originating at the poles. 

For Example 8.2, we can make the following qualitative observations: 

■ At co = 0 rad/s, the lengths of the vectors originating from the two zeros are 
minimized, and hence we would expect that the DC gain would be somewhat 
lower than the gain at medium frequencies. 

■ At co = +V2 rad/s, the lengths of the vectors originating from the poles 
p , = — 5/2 ± j-Jl are minimized, and hence we could expect that the gain at 
those frequencies would be somewhat higher than the gain at low and high 
frequencies. 
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■ The phase at ft) = 0 is -n rad and has a net contribution of -n rad only from the 
zero Zj = 2 . This is to be expected since the transfer function of Equation 8.5 
at s = 0 is equal to -1/6. The angles of the two vectors originating from the 
complex conjugate poles cancel each other out. 

■ The phase around co = + V 2 rad/s should be more sensitive to a small change 
in cn than elsewhere. This is even more noticeable when the complex poles are 
closer to the imaginary axis. For ft) = \fl rad/s, the angle of the vector origi- 
nating from the pole p = — v/2 + j\fl quickly goes from a significant negative 
angle to a significant positive angle as ft) varies from \[l - A to + A rad/s. 
This implies a relatively fast negative drop in the phase plot of the frequency 

response around ft) = %/ 2 rad/s. 

■ At ft) = +°<\ the phase is -n/2 rad. This comes from a contribution of-Jt/2 from 
the three pole vectors, a contribution of n/2 from the right half-plane (RF1P) 
zero vector, and a contribution of n/2 from the left half-plane (LFIP) zero vec- 
tor. The magnitude at ft) = +°° is 0 as the two zero vectors tending to infinity 
in length are not sufficient to counteract the three pole vectors also tending to 
infinity in length. 

■ At ft) = - 00 , the phase is n/2 rad. This comes from a contribution of n/2 from 
the three pole vectors, a contribution of-7t/2 from the RHP zero vector, and a 
contribution of-7i/2from the LHP zero vector. The magnitude at ft) = -00 is 0. 

A portion of the magnitude of the transfer function H(s ) of Equation 8.5, which 
is represented as a surface over the complex plane, is shown in Figure 8.4. The 
edge of that surface along the imaginary axis is nothing but the magnitude of the 
frequency response of the system. 



FIGURE 8.4 Magnitudes of the transfer function and its 
frequency response over a portion of the complex plane. 
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Remark: The definition of an angle is sometimes ambiguous. In Example 8.2, we 

have defined the angle of the right half-plane zero vector as being measured counter- 
clockwise along positive angles for 0 )> 0 and as being measured clockwise along neg- 
ative angles for ca< 0. This allowed us to obtain ZH(j°°) = -ZH(-j°°) = —n / 2 rad, 
which is consistent with the fact that the frequency-response phase of an LTI differ- 
ential system with real coefficients is an odd function of frequency. However, for most 
purposes, the angle Till rad can be considered the same as —3 71/2 rad. 



((Lecture 27: The Bode Plot)) 


BODE PLOTS 


It is often convenient to use a logarithmic scale to plot the magnitude of a fre- 
quency response. One reason is that frequency responses can have a wide dynamic 
range covering many orders of magnitude. Some frequencies may be amplified by 
a factor of 1 000, while others may be attenuated by a factor of 1 0 4 . Another rea- 
son is that using a log scale, we can add rather than multiply the magnitudes of cas- 
caded Fourier transforms, which is easier to do graphically: 

log | Y {jco)\ = log | // (yft>)| + log \X{j<±>)\. (8.7) 

It is customary to use the decibel (dB) as the logarithmic unit. The bel (B) was 

i i 2 

defined (after Alexander Graham Bell) as a power amplification of \H( jco)\ =10 
for a system. The decibel is one tenth of a bel. Therefore, for a system with a power 
gain of 1 0 at frequency 0), its power gain in dB is 

dB 

10 — x log 10 \H(jco)\ 2 B = 101og l0 10 dB = 10 dB. (8.8) 

B 

To measure the actual magnitude gain (not the power gain) of a system, we use 
the identity 

101og 10 \H(jcof dB = 20 log l0 \H(jco)\ dB. (8.9) 

Thus, a magnitude plot of | H(j to ) | is represented as 20 \og l() \H(jo))\ dB using 
a linear scale in dB. Table 8.1 shows the correspondence between some gains and 
their values expressed in dB. 
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TABLE 8.1 Gain Values Expressed in Decibels 


Gain 

Gain (dB) 

0 

— °° dB 

0.01 

-40 dB 

0.1 

-20 dB 

1 

0 dB 

10 

20 dB 

100 

40 dB 

1000 

60 dB 


It is also convenient to use a log scale for the frequency, as features of a fre- 
quency response can be spread over a wide frequency band. 

A Bode plot is the combination of a magnitude plot and a phase plot using log 
scales for the magnitude and the frequency and using a linear scale (in radians or 
degrees) for the phase. Only positive frequencies are normally considered. As 
stated above, the Bode plot is quite useful since the overall frequency response of 
cascaded systems is simply the graphical summation of the Bode plots of the indi- 
vidual systems. In particular, this property is used to hand sketch a Bode plot of a 
rational transfer function in pole-zero form by considering each first-order factor 
corresponding to a pole or a zero to be an individual system with its own Bode plot. 

Example 8.3: Consider again the first-order system with transfer function 

H (s) — — - — , Re{.v} > — 2, (8.10) 

s + 2 


which has the frequency response 


H(jco) = 


1 _ 

jco + 2' 


( 8 . 11 ) 


It is convenient to write this frequency response as the product of a gain and a 
first-order transfer function with unity gain (0 dB) at DC : 




1 1 
2 j(o / 2 + 1 


( 8 . 12 ) 
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The break frequency is 2 rad/s. The Bode magnitude plot is the graph of: 
201og 10 \H{j( 0 )\ = 201og 10 ]- +20 log l0 dB 

= -201og 10 2-201og l0 |f + l| dB 
= -6dB-201og 10 |f + l|dB. (8.13) 

Note that for low frequencies, that is, (0 « 2, 

201og 10 \H(jco)\ « -6 dB-20 log 10 |l| dB = -6 dB, (8.14) 

and for high frequencies, that is, co»2, 

201og 10 |//O'cn)| = -6 dB-201og 10 y dB 

= -6 dB - 201og l0 |o| dB + 201og 10 2 dB 
= -201og l0 |co| dB. (8.15) 

For co = 10 rad/s in Equation 8.15, we get -20 dB, for a> = 100 rad/s, we get 
-40 dB, etc. The slope of the asymptote -201og 10 \o)\ dB is therefore -20 decibels 
per decade of frequency (a decade is an increase by a factor of 10.) With the as- 
ymptotes meeting at the break frequency 2 rad/s, we can sketch the magnitude 
Bode plot as shown in Figure 8.5 (dotted line: actual magnitude.) 



FIGURE 8.5 Bode magnitude plot of a first-order 
transfer function. 
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The Bode phase plot is the graph of 


ZH(jco) = Z 


1 1 
2 jco / 2 + 1 


= Z 


1 

j(o / 2 + 1 


f 

= arctan 

V 




(8.16) 


We know that the phase is 0 at co = 0 and 7t at co = °°. A piecewise linear ap- 
proximation (with a log frequency scale) to the phase that helps us sketch it is given 

by 


ZH (jco) = 


0, co<± 


-f[log 10 (f) + l], ^<(0 < 20 . 


-f, co > 20 


(8.17) 


The approximation given by Equation 8.17 deserves some explanations. The 
phase approximation is constructed as follows: 


■ At frequencies lower than one decade below the break frequency, the phase is 0. 

■ At frequencies higher than one decade above the break frequency, the phase is 

-Till. 

■ In the interval from one decade below to one decade above the break fre- 
quency, the phase is linear and goes from 0 to -Till with a slope -7t/4 radian per 
decade. 

The Bode phase plot is shown in Figure 8.6. The interactive Bode applet on the 
companion CD-ROM located in D:\Applets\BodePlot\Bode.exe lets the user enter 
poles and zeros of a transfer function on a pole-zero plot and it then produces a 
Bode plot of the transfer function. Both the actual frequency response plot and the 
broken line approximation obtained using the above rules are shown on the applet’s 
Bode plot for comparison. 



FIGURE 8.6 Bode phase plot of a first-order transfer function. 
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Note that the Bode magnitude plot of s + 2 (the inverse of H(s)) is simply the 
above magnitude plot flipped around the frequency axis (see Figure 8.7), and like- 
wise for the phase plot in Figure 8.8. 



FIGURE 8.7 Bode magnitude plot of s + 2. 



Example 8.4: Consider the second-order stable system with transfer function 


H(s) = 


5 + 100 


= 10 - 


r + 1 


(r+lls + io) (s + l)(^ + l) 
which has the frequency response 


, Re{.v} > — 1, 


(8.18) 


H(ja>) = 10 


J°>- + 1 

100 


(y« + l)(+y + 1 ) 


(8.19) 
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The break frequencies are at 1, 10, and 100 rad/s. For the Bode magnitude plot, 
we can sketch the asymptotes of each first-order term in Equation 8.19 on the same 
magnitude graph (as dashed lines) and then add them together as shown in Figure 8.9. 


201og 10 | H{j(o)\ 



FIGURE 8.9 Bode magnitude plot of a second-order example. 


We proceed in a similar fashion to obtain the Bode phase plot of Figure 8.10. 



FIGURE 8.10 Bode phase plot of a second-order example. 



ON THE CD 


A Bode plot can easily be obtained in MATLAB. The following MATLAB 
script bodeplot.m, which is located on the CD-ROM in D:\Chapter8, produces the 
Bode plot of Example 8.4. 
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%% bodeplot.m Bode plot of a transfer function 
% transfer function numerator and denominator 
num=[1 100]; 
den=[1 11 10]; 
sys=tf (num,den) ; 

% frequency vector 
w=log space] -2,4,200) ; 

% Bode plot 
bode(sys,w) 



((Lecture 28: Frequency Responses of Lead, Lag, and Lead-Lag Systems)) 


FREQUENCY RESPONSE OF FIRST-ORDER LAG, LEAD, AND 
SECOND-ORDER LEAD-LAG SYSTEMS 


First-order lag systems and lead systems can be considered as building blocks in 
filter and controller design. They have simple transfer functions with lowpass and 
highpass frequency responses, respectively, which can be combined into a second- 
order lead-lag system that has applications in sound equalization and feedback 
control design. 

First-Order Lag 

A first-order lag has a transfer function of the form 

H(s)= aZS + 1 , Re{s} > — — , (8.20) 

zs + 1 x 

where 0 < « < 1 , x>0 is the time constant and x~ l (the absolute value of the pole) 
is called either the natural frequency, the cutoff frequency, or the break frequency, 
depending on the application. This system is called a lag because it has an effect 
similar to a pure delay of x seconds e~ rs at low frequencies, especially for a = 0. 
To see this, expand H(s) as a Taylor series around s = 0: 

— - — = 1-ts + (ts) 2 -(ts) 3 + ... (8.21) 

Ts + 1 

, (fs ) 2 ('rs ) 3 

e = 1-TS + - — — — — + .... 


2 


3! 


( 8 . 22 ) 
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To first order, these systems are identical. In the previous section, we studied 
the frequency response of a first-order lag as an example with r = l/ 2 and a = 0. 
In the case a^O, the Bode plot is as shown in Figure 8. 1 1 and Figure 8.12. 



FIGURE 8.1 1 Bode magnitude plot of a first-order lag. 


ZH(ja>) 



FIGURE 8.12 Bode phase plot of a first-order lag. 


The general first-order lag can be thought of as a lowpass filter. Note that the 
high-frequency gain is a, and the phase tends to 0 at high frequencies, unless a = 
0, in which case it tends to -n/2. A first-order lag can be realized with the block di- 
agram shown in Figure 8.13. 
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FIGURE 8.13 Realization of a first-order lag. 


First-Order Lead 

A first-order lead also has a transfer function of the form 

H(s)= aZS + l , Re{.v} > — — , (8.23) 

TS + 1 X 

where f > 0 but a > 1. The Bode plot for this system (assuming that a > 10) is 
shown in Figure 8. 14 and Figure 8. 15. 



ar v-\fa r 

FIGURE 8.14 Bode magnitude plot of a first-order lead. 

For the case where x — > 0, ax — > T , the first-order lead is equivalent to a dif- 
ferentiator with gain T in parallel with the identity system: 


H(s) = Ts+\, 


(8.24) 
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FIGURE 8.15 Bode phase plot of a first-order lead. 


and its Bode plot is given in Figure 8.16. Note that the high frequencies are ampli- 
fied: the higher the frequency, the higher the gain of the system is. This is a prop- 
erty of differentiators, and it explains why high-frequency noise is greatly 
amplified by such devices. The maximum positive phase is Jt/2 rad for 0 ) = +°°. 




FIGURE 8.16 Bode plot of a limit case of first-order lead H(s) = Ts + 1. 
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Applications: The first-order lead may be used to “differentiate” signals at fre- 

quencies higher than (oaf' rad/s but lower than z~ l rad/s . It can help “reshape” 
pulses that have been distorted by a communication channel with a lowpass fre- 
quency response. It is also often used as a controller because it adds positive phase 
to the overall loop transfer function (more on this in Chapter 1 1 .) A first-order lead 
system can be realized with the same interconnection as that shown in Figure 8.13 
for a first-order lag. 


Second-Order Lead-Lag 

A second-order lead-lag system has a transfer function of the form 


HW= K(m - S + IX^ + T Re{.,} > — t 

(T„S + 1)(V+1) Z b 


(8.25) 


where z~ l > z(' > 0 are the lead and lag frequencies, respectively, and 
a > 1, 0 < yS < 1 . This system amplifies the low frequencies and the high frequen- 
cies, like a rudimentary equalizer in a stereo system. It is often used as a feedback 
controller to get more gain at low frequencies and positive phase at the mid- 
frequencies. This should become clear in Chapter 11, where feedback control the- 
ory is introduced. The Bode magnitude plot for this lead-lag system, where 
K = j8 _1 , is shown in Figure 8.17. 



FIGURE 8.17 Bode magnitude plot of a second-order lead-lag. 
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FREQUENCY RESPONSE OF SECOND-ORDER SYSTEMS 


A general second-order system has a transfer function of the form 
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H(s) = 


b 2 s 2 + b y s + b Q 
a^s 2 + a { s + a 0 


(8.26) 


It can be stable, unstable, causal, or not causal, depending on the signs of the 
coefficients and the specified region of convergence (ROC). Let us restrict our at- 
tention to causal, stable LTI second-order systems of this type. A necessary and 
sufficient condition for stability is that the coefficients a, be either all positive or all 
negative, which ensures that the poles are in the open left half-plane. This is also a 
necessary, but not sufficient, condition for stability of higher-order systems. Let us 
also assume that b 2 = b l = 0 ; that is, we basically have a lowpass system with two 
poles and no finite zero. Under these conditions, the transfer function can be ex- 
pressed as 


H(s) = 


Aco 


2 

n 


s 2 + 2£co il s + co; ’ 


(8.27) 


where C, is the damping ratio and co„ is the undamped natural frequency of the 
second-order system. Systems that can be modeled by this transfer function include 
the mechanical mass-spring-damper system, and the lowpass second-order RLC 
filter, which is a circuit combining an inductance L, a capacitance C, and a resis- 
tance R. 


Example 8.5: Consider the causal second-order transfer function 

1 


H(s) = 


-2s 2 -6s -9 


1 


1 


2 s 1 + 3s + 9/2 


(8.28) 


Its undamped natural frequency is (O n = 3v2/2, and its damping ratio is 


c= 


1 V2 


2 co n 2^# V2 2 


= 0.707. 


(8.29) 


Since the damping ratio is less than one, the two poles are complex. The poles 
are given by 


P i 


r 3V2V2 .3V2 rr 3 .3 

= -^co n + jcoJ\-C =-— — + j— + 


2 2 


P2=~C^„-mJi-C 2 =_ 2 _ 7 2 ‘ 


(8.30) 
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There are three cases of interest for the damping ratio that lead to different pole 
patterns and frequency response types. 


Case £ > 1 


In the case C, > 1, the system is said to be overdamped. The step response does 
not exhibit any oscillation. The two poles are real, negative, and distinct: 

Pi = + °K \]C and p 2 = - co n -1 . The second-order system 

can then be seen as a cascade of two standard first-order systems: 


H(s) = 


Acol _ Aor 

l > ) 

r i i 

— A 

( > 1 

f 1 ] 

s 2 +2£co n s + (o;, p,p 2 

+ 
| 1 


— /i 

1 1 

+ 



(8.31) 


The Bode plot of H{ja>) = A jJ jJ can be sketched using the technique 

-pi + 1 -pi + 

presented in the previous section for systems with real poles and zeros. 


Case C, - 1 

In the case C, = 1, the system is said to be critically damped. The two poles 
are negative and real, but they are identical. We say that it is a repeated pole; 

Pi =-£©„ + jco n \l 1-f 2 = -C(» n = p 2 . In this situation, the second-order system 
can also be seen as a cascade of two first-order transfer functions with the same 
pole: 


H(s) = A 


(4r +1 ) 


(8.32) 


Case C, < 1 

In the case C, < 1 , the system is said to be underdamped. The step response exhibits 
some oscillations, although they really become visible only for f < l/ %/2 =0.707 . 
The two poles are complex and conjugates of each other: /;, = -Co) n + jco n -y/l - £ 2 , 

Pi = -£<*>„- 7«„Vi-C 2 • 

The magnitude and phase of the frequency response 


H(jco) = 


A «K 

(jcof + 2^a It (j(0) + col 


( ja> ) 
a>l 


+ I^(7 W ) + 1 


(8.33) 
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are given by 


20 log 10 \H(jco)\ = 20 log 10 A - 10 log 10 



(8.34) 


ZH(jco) = -arctanl 


2C 


(On 



(8.35) 


Notice that the denominator in Equation 8.33 was written in such a way that its 
DC gain is 1 . The break frequency is simply the undamped natural frequency. At 
this frequency, the magnitude is 

20 log 10 \H(jco n )\ = -201og 10 {2£}. (8.36) 

For example, with £ = 0.1 and A = 1, the magnitude at co n is 13.98 dB. Note that 
this is not the maximum of the magnitude, as it occurs at the resonant frequency, 

«ma* -=CoJ\-2C, (8.37) 


which is close to 0 )„ for low damping ratios. At the resonant frequency, the mag- 
nitude of the peak resonance is given by 


20log IH |/7(yft> max ) 



1 - 


(o^-2f) '\ 

/ 


+ 4C 2 


1-2C 2 ) ) 
(On j 


-101og 10 {4C 4 +4C 2 (l-2C 2 )} 
-101og 10 {4C 2 (l-C 2 )} 
-201og 10 {2C N /l ^C 2 } 


(8.38) 


and thus for our example with £ = 0.1 and A = 1, 201og 10 \H(jco m . dX )\ = 16.20 dB. 

The Bode plot for the case C, < 1 can be sketched using the asymptotes as in 
Figure 8.18, but at the cost of an approximation error around co n that increases as 
the damping ratio decreases. The roll-off rate past the break frequency is -40 
dB/decade. The phase starts at 0 and tends to -n at high frequencies. 

The Bode plot approximation using the asymptotes does not convey the infor- 
mation about the resonance in the system caused by the complex poles. That is, the 
damping ratio was not used to draw the asymptotes for the magnitude and phase 
plots. The peak resonances in the magnitude produced by different values of C, < 1 
are shown in Figure 8.19. This figure also shows that the phase drop around the 
normalized undamped natural frequency co„ = 1 becomes steeper as the damping 
ratio is decreased. 
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ON THE CD 




FIGURE 8.18 Bode plot of a second-order system: 
broken line approximation. 


The following MATLAB script, zetas.m, located on the CD-ROM in D:\Chap- 
ter8, was used to produce the Bode plots in Figure 8.19. 

%% zetas.m Script used to produce the Bode plots of second-order 
systems 

%% with different damping ratios 
zeta=[0.01 [ . 1 : .2:0.9] 1] 
num=1 ; 

w=logspace( -1 , 1 ,1000) ; 
for k=1 :length(zeta) 
den ( k , : ) = [ 1 2*zeta(k) 1]; 

[mag( : ,k) , ph( : ,k) ]=bode(num,den(k, : ) ,w) ; 
end 

figure ( 1 ) 

semilogx(w,20*log10(mag) , ’ -k’ ) 
figure(2) 

semilogx(w,pi*ph/180, ’ - k’ ) 
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FIGURE 8.19 Bode plots of second-order system H(s)= s2+2 l s+1 for 
various damping ratios. 


Quality Q 

In the field of communications engineering, the underdamped second-order filter 
has played an important role as a simple frequency-selective bandpass filter. When 
the damping ratio is very low, the filter becomes highly selective due to its high 
peak resonance at ® max . The quality Q of the filter is defined as 
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Q 



(8.39) 


The higher the quality, the more selective the bandpass filter is. To support 
this claim, the -3 dB bandwidth (frequency band between the two frequencies 
where the magnitude is 3 dB lower than 201og 10 |//(y'co max )| ) of the bandpass sec- 
ond-order filter shown in Figure 8.20 is given by 


Am = ° X ^- = 2L<x> 

Q 


(8.40) 



FIGURE 8.20 Bode magnitude plot of a second-order 
bandpass system. 


Maximal Flatness and the Butterworth Filter 

In the transition from a second-order system without resonance to one that starts to 
exhibit a peak, there must be an optimal damping ratio C, for which the magnitude 
stays flat over the widest possible bandwidth before rolling off. It turns out that this 
occurs for £ = l/v2 =0.707 . For this damping ratio, the real part and imaginary part 
of the two poles have the same absolute value, and the poles can be expressed as 

.3 k ,3k 

Pi = 00 e 4 , p 2 = COe 1 4 . (8.41) 

We recognize the poles of a lowpass second-order Butterworth filter with cut- 
off at oo n . Thus, a Butterworth filter is optimized for its magnitude to be maximally 
flat, as can be seen in Figure 8.19 for the case C, = 0.7. 



Time and Frequency Analysis of BIBO Stable, Continuous-Time LTI Systems 307 



((Lecture 30: The Step Response)) 


STEP RESPONSE OF STABLE LTI SYSTEMS 


A step response experiment is a simple way to characterize a stable LTI system. It 
is often used in the process industry to help identify an LTI model for the process. 
Theoretically, the step response conveys all the dynamical information required to 
characterize the system uniquely, since it is the integral of the impulse response. 
Note that only step responses of lowpass systems with nonzero DC gains are of in- 
terest here. We are not really interested in step responses of highpass or bandpass 
systems, or more generally of systems with a DC gain of 0. 

As engineers, we would like to be able to perform quick quantitative and qual- 
itative analyses on the step response of a system without first having to transform 
it to the Laplace domain. Qualitative observations can be made about the rise time 
(fast, sluggish), the overshoot and ringing, etc. On the other hand, more quantita- 
tive observations can also be made once unequivocal definitions for quantities like 
the rise time and the settling time are given. 

Rise Time 

The rise time of a step response is often used as a qualitative measure of how fast 
or sluggish a system is, but we can define it unambiguously and use this definition 
to compare systems between them. One typical definition for the rise time t r of a 
system initially at rest is the time taken by the output to rise from 5 to 95% of its 
final value, as illustrated in Figure 8.21. 



FIGURE 8.21 Definition of rise time. 


Note that a step response could have a desirably fast rise time but so much 
overshoot and ringing that the corresponding system may be judged to have poor 
performance. A measure of overshoot is given in the next section. 
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One thing to remember is that the larger the frequency bandwidth of a system, 
the shorter the rise time. For instance, the step response of a lowpass filter with a 
cutoff frequency of 1 MFIz will have a fast, sub-microsecond rise time. 

First-Order Lag 

For a first-order lag with a = 0 and time constant x, that is, 

H(s) = - i —, (8.42) 

TS + 1 

the step response is 

t 

s(t) = (1 - e t )u(t). (8.43) 



FIGURE 8.22 Rise time of a first-order lag with a = 0. 


The 95% rise time is given by the difference between the times when the re- 
sponse reaches the value 0.95 and the value 0.05, as shown in Figure 8.22: 

*95% 

0.95 = 1-e * 

*5% 

0.05 ~\-e ' 

t = 2.9957t-0.0513t = 2.9444t. 

r 


=> t 95% = -xlnO.05 = 2.9957T. ( 8 - 44 ) 

=> t 5% = -Tin 0.95 = 0.05 13 t. (8 - 45) 


For the case 0 < a < 1 and time constant x, that is, 
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H(s) = 


octs + 1 
TS + 1 


= a + 


\-a 

TS + 1 


(8.47) 


the step response is 

t 

s(t) = au(t) + (1 - a)(\ - e T )u(t). (8.48) 

The 95% rise time is given by the difference between the times when the re- 
sponse reaches the value 0.95 and the value 0.05. If a > 0.05, then the output is 
already larger than 0.05 at t = 0 + (see Figure 8.23). 



FIGURE 8.23 Rise time for a first-order lag. 


On the other hand, if a > 0.95, then the rise time is 0. 

( 95% 

0.95 = a + (l-a)(l-e T ) 

=> t 95% = -T(ln0.05 - ln( 1 — a)) = [2.9957 + ln( 1 - a)]x (8.49) 

t 5% 

0.05 = a + (1 - a)(l - e T ) 

=> t 5% =-T(ln0.95-ln(l-a)) = [0.0513 + ln(l-a)]T (8.50) 

For the case 0 < a < 0.05 , the rise time is 

t r = t l)5% - 1 5% = -r(ln0.05 - ln0.95) = 2.9957t-0.0513t = 2.9444t (8.51) 
For the case 0.05 < a < 0.95, the rise time is 
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t r = t g5% = [2.9957 + ln( 1 — a)]z. (8.52) 

Notice that the rise time is 0 for a = 0.95, as expected. 

For the case -1 < a < 0 and time constant x, the system has an open right half- 
plane (RHP) zero. 


H(s) = 


OCXS + 1 
TS + 1 


= a + 


l-a 

TS + 1 


(8.53) 


and the step response is (see Figure 8.24) 

t 

s(t) = au(t ) + (1 - «)(1 - e T )u(t). (8.54) 



FIGURE 8.24 Rise time of a non-minimum phase system. 


According to our definition, the 95% rise time is given by the difference be- 
tween the times when the response reaches the value 0.95 and the value 0.05: 

( 95% 

0.95 = 1-(1 -a)e 1 => t g5% = -T(ln0.05- ln(l-a)). (8.55) 

{ 5% 

0.05 = l-(l-a)e T => t 5% = -T(ln0.95-ln(l-a)). (8.56) 

t r ,=t g5% -t 5% =-T(ln0.05- ln0.95) = 2.9957x- 0.051 3 t = 2.9444t. (8.57) 
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An important thing to notice in Figure 8.24 is that the step response starts in the 
“wrong direction.” That is, we want the output to go to 1, but it actually goes neg- 
ative first before rising toward 1 . This phenomenon, which causes problems for 
feedback control systems, is associated with systems with RF1P zeros, which are 
also called non-minimum phase systems. 

Second-Order Systems 

We could do a similar analysis for the step response of second-order systems, al- 
though it is perhaps better to do it on a case-by-case basis. Suffice it to say that the 
rise time primarily depends on the undamped natural frequency, but also on the 
damping ratio. For a given co n , the rise time is fastest for £ « 1, at the expense of 
a large overshoot. A good tradeoff for a relatively fast rise time with low or no 
overshoot is obtained for 0.5 < f < 1 . 

Overshoot 

A step response is said to overshoot if it goes past its settling value (see Figure 
8.25). The amount of overshoot (we usually consider the first overshoot) can be 
measured as a percentage of the final value of the output signal. 



FIGURE 8.25 Definition of overshoot in the step response. 


There is no overshoot to speak of for first-order systems, except for first-order 
leads. Step responses of lead systems have an initial value that is larger than the 
final value (use the initial value theorem to show this). 

The step response of a second-order order system of the form 

acq; 

s 2 + 2(^(0 n s + co; 


H(s) = 


(8.58) 
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overshoots if £ < 1. The percentage overshoot OS can be computed by finding the 
maximum value of the step response of the system. The maximum occurs for 


0 = 


ds(t) 

dt 


= h(t). 


(8.59) 


and thus, we must solve Equation 8.59 for t max . The impulse response h(t) of the 
second-order system of Equation 8.58 is given by 


-C,(o n t 


h(t ) = A f- — - sin(m f ,^l-g' 2 0- 


(8.60) 


Note that co n l-£ 2 is called the damped natural frequency. Solving Equation 
1.59, we find 


co„e 


-£co n t m 


h(t max ) = A 






(8.61) 


It can be shown that the step response of the system is given by the right-hand 
side of the first equality in Equation 8.62. We now have to evaluate s(t ): 




cos(m„7l-C 2 0- 


c 


Vi 7 ? 


:sm(co n ^l-£ 2 t) 


u(t)\ 


Jn 


= AU-e 


cos(7r) + 




^sin(7r) 


u(t) 




= A( 1 + e ^). 


(8.62) 


Finally, the percentage overshoot is given by 


OS = 100 


S(lmax)-A 




= 100e 77 %. 


(8.63) 


The percentage overshoot is given for different values of the damping ratio in 
Table 8.2. 
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TABLE 8.2 Percentage Overshoot 
Versus Damping Ratio 


c 

OS (»/o) 

0.1 

72.9 

0.2 

52.7 

0.3 

37.2 

0.4 

25.4 

0.5 

16.3 

0.6 

9.5 

0.707 

4.3 

0.8 

1.5 

0.9 

0.2 

1 

0.0 


Settling Time 

The settling time measures how fast the response practically reaches steady-state. 
It is defined as the time when the response first reaches the final value to a certain 
percentage and stays within that percentage of the final value for all subsequent 
times. For example, the +5% settling time t s is the time when the response gets to 
within 5% of its final value for all subsequent times, as depicted in Figure 8.26. 



FIGURE 8.26 Definition of settling time. 
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First-Order Lag 

For a first-order lag with a = 0 and time constant x, that is, 

= (8.64) 

TS + 1 

the step response is (see Figure 8.27) 

t 

s(t) = (\-e t )u(t). (8.65) 



FIGURE 8.27 Settling time for a first-order lag with a = 0. 


We know that this step response increases monotonically toward 1. Flence the 
+5% settling time is given by 

t s 

0.95 = l-e* => = -Tln0.05 = 2.9957T = 3T, (8.66) 

and we have the following rule of thumb: 

■ The +5% settling time of a first-order lag of the form of Equation 8.64 is equal 
to three time constants. 

Note that the settling time for first-order lags with different values of a con- 
sidered above is equal to t 95% . 

Second-Order Systems 

The settling time for a second-order system depends primarily on the undamped 
natural frequency, but also on the damping ratio. It should be determined on a case- 
by-case basis because for a given co n , the settling time is a nonlinear function of f. 
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We can see this from the step response plot in Figure 8.26. The response enters the 
+5% band from the top, but if we gradually increased the damping ratio, then the 
response would eventually enter that band from below, causing a discontinuity in 
the settling time as a function of 

v c Remark: The step response of a system is easy to plot in MATLAB. Consider, 

on the cd f or example, the M-file D:\Chapter8\stepresp.m given below. 

%% stepresp.m Plots the step response of a system 
% numerator and denominator of transfer function 
num=[ 1 ] ; 
den=[ 1 3 9] ; 
sys=tf (num,den) ; 

% time vector 
tf inal=1 0 ; 
step(sys,tfinal) ; 


IDEAL DELAY SYSTEMS 


The transfer function of an ideal delay of T time units is 

H(s) = e~ sT . (8.67) 

The magnitude of its frequency response H(jco) = e~ J<oT is 1 for all frequen- 
cies, whereas its phase is linear and negative for positive frequencies. The Bode 
plot of a pure delay system is shown in Figure 8.28. Note that the phase appears to 
be nonlinear because of the logarithmic frequency scale. 


a 201og 10 \H(Jco)\ 



FIGURE 8.28 Bode plot of an ideal delay system. 




316 Fundamentals of Signals and Systems 


GROUP DELAY 


We have just seen that a pure delay corresponds to a linear negative phase shift. A 
lowpass system also has a negative phase, so it must have an effect similar to a time 
delay on the input signal. If we look at a narrow frequency band where the phase 
is almost linear, then an input signal with energy restricted to that band will be de- 
layed by a value given by the slope of the phase function. This is called the group 
delay, and it is defined as follows: 

T(co ):= — —ZH(jco). ( 8 . 68 ) 

dco 

Suppose that the magnitude of a system is constant, but its phase is not. The 
output signal will be distorted if the group delay is not constant, that is, if the phase 
is nonlinear. In this case, the complex exponentials at different frequencies that 
compose the input signal get delayed by different amounts of time, thereby caus- 
ing distortion in the output signal. 


NON-MINIMUM PHASE AND ALL-PASS SYSTEMS 


Systems whose transfer functions have RHP zeros are said to be non-minimum 
phase. This comes from the Bode phase plot of such systems. There always exists 
a minimum-phase system whose Bode magnitude plot is exactly the same as that 
of the non-minimum phase system but whose phase is “less negative.” 

Hendrik Bode showed that for a given magnitude plot, there exists only one 
minimum-phase system that has this magnitude. Moreover, the phase of this sys- 
tem can be uniquely determined from the magnitude plot. There also exists an in- 
finite number of non-minimum phase systems that have the same magnitude plot, 
yet their phase plots are “more negative”; that is, they fall below the phase plot of 
the minimum-phase system. 

Example 8.6: Consider the minimum-phase system H(s) = 1. The magnitude of 

its frequency response if 1, and its phase is zero for all frequencies. Now consider 
the system 




-s + 1 
5 + 1 ' 


(8.69) 
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This is a non-minimum phase system whose magnitude of the frequency re- 
sponse is 1 for all frequencies. Its phase is given by 


f -co ' 

( -CO \ 


+ arctan 

1 1 J 

l 1 ) 


2arctan (co), (8.70) 

which tends to -n as co — > °° . The Bode plot of this system is given in Figure 8.29. 


n 

(dB) 


0 


201og 10 |// 1 (»| 

0.1 1 10 

—i 1 1- 


► 

CO (log) 



FIGURE 8.29 Bode plot of a first-order non-minimum 
phase system. 


Such a system is called an allpass system because it passes all frequencies with 
unity gain. Thus an allpass system has unity magnitude for all frequencies but can 
have any phase function. 


Example 8.7: The non- minimum phase system 

*,(,)- -* +10 ° 

1 (s + l)(s + 10) 

has the same magnitude as the minimum-phase system 

.v + 100 


(8.71) 


H(s) = 


(s + !)(« + 10) 


(8.72) 
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given in Example 8.4, but its phase is more negative, as shown in the Bode phase 
plot of Figure 8.30. Note that any non-minimum phase transfer function can be ex- 
pressed as the product of a minimum phase transfer function and an allpass trans- 
fer function. For the Example 8.7, we can write 


H l (s) = 


s + 100 -5 + 100 

(s + l)(s + 10),s + 100/ 

minimum-phase allpass 


(8.73) 


The Bode phase plots of H(s ) and are shown in Figure 8.30. 



FIGURE 8.30 Bode phase plot of minimum phase and non-minimum phase 
systems. 


Finally, as mentioned earlier, the step response of a non-minimum-phase sys- 
tem often starts off in the wrong direction, which makes these systems difficult to 
control. 
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SUMMARY 


In this chapter, we analyzed stable continuous-time LTI systems in the frequency 

domain and in the time domain. 

■ A qualitative relationship between the pole-zero plot and the frequency re- 
sponse of a stable LTI system was established. 

■ The Bode plot was introduced as a convenient representation of the frequency 
response of a system that can be sketched by hand. 

■ We characterized the frequency responses of first-order lag and lead systems 
and of second-order systems. 

■ The time domain performance of first- and second-order systems was quanti- 
fied using the step response. The classical performance criteria of rise time, set- 
tling time, and overshoot were discussed. 

■ We briefly discussed the issues of group delay, allpass systems, and non- 
minimum phase systems. 


TO PROBE FURTHER 


Bode plots can be used in the analysis of feedback control systems as we will find 
out in Chapter 11. See also Belanger, 1995 and Kuo and Golnaraghi 2002. For fur- 
ther examples of step responses of LTI systems, see Kamen and Heck 1999. 


EXERCISES 


Exercises with Solutions 


Exercise 8.1 

Sketch the pole-zero plots in the .v- plane and the Bode plots (magnitude and phase) 
for the following systems. Specify if the transfer functions have poles or zeros at 
infinity. 


(a) 


H(s) = 


100(5 -l)(.v + 10) 
(5 + IOO ) 2 


Re{.v} > -100 


Answer: 


, 100(5-1X5 + 10) -0.1(-5 + 1)(5/10 + 1) n ^ 1nn 

H(s) = r = , Re{5>>-100 

(5 + 100) 2 (0.015 + I)(0.0l5 + 1) 
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The break frequencies are at co t = 1, co 2 = 10 (zeros); co 3 = 100 (double pole) . 
The pole-zero plot is shown in Figure 8.3 1 , and the Bode plot is shown in Figure 8.32. 


(b) 


H(s) = 


s + 10 

5(0.0015 + 1)’ 


Re{.v} > 0 


1 





w p i' // ,// jy fl* $ a 

- ,o ° si 


;Re{.v} 


FIGURE 8.31 Pole-zero plot of the transfer 
function of Exercise 8.1 (a). 




FIGURE 8.32 Bode plot of the transfer function 
of Exercise 8.1 (a). 


Time and Frequency Analysis of BIBO Stable, Continuous-Time LTI Systems 321 




FIGURE 8.33 Pole-zero plot of the transfer 
function of Exercise 8.1 (b). 

The break frequencies are co, = 10 (zero); co 2 = 0, co 3 = 1000 (poles) , and the 
transfer function has one zero at The Bode plot is shown in Figure 8.34. 



FIGURE 8.34 Bode plot of the transfer function of Exercise 8.1 (b). 
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H(s) 


(c) 


H(s) = 


s 2 +25 + 1 

(5 + 100)(5 2 + 105 + 100)’ 


Re{5} > -5 


Answer: 

We can write the transfer function as follows: 


0.0001(5 + 1) 2 

(0.01s + I)(0.0l5 2 + 0.15 + 1) 


0.01(5 + 1) 2 

(0.015 + 1)(5 + 5 - y'5 V3)(5 + 5 + j5S) 


Re{5> > -5 


The pole zero plot is shown in Figure 8.35, and the Bode plot is shown in Fig- 
ure 8.36. 



. Im(s[ 


X 

1 ^ 

- sF 


1 

-5; -1 

X 

1 

1 

- - s>/3 

Re |s 


FIGURE 8.35 Pole-zero plot of the 
transfer function of Exercise 8.1 (c). 


Exercise 8.2 

Consider the mechanical system in Figure 8.37 consisting of a mass m attached to 
a spring of stiffness k and a viscous damper (dashpot) of coefficient b, both rigidly 
connected to ground. This basic system model is quite useful for studying a num- 
ber of systems, including a car’s suspension or a flexible robot li nk . 

Assume that the mass-spring-damper system is initially at rest, which means 
that the spring generates a force equal, but opposite to, the force of gravity to sup- 
port the mass. The balance of forces on the mass causing motion is the following: 

d 2 y(t) 

x(t)-F k (t)-F b (t) = m-^- 

(a) Write the differential equation governing the motion of the mass. 

Answer: 


d y(t) , , dy(t) 

m — — — l -b — : 1- ky{t) = x(t) 


dt 


dt 
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FIGURE 8.36 Bode plot of the transfer function of Exercise 8.1 (c). 



force applied on mass by spring and gravity: 

F k {t) = ky{1) 

force applied on mass by damper: 


K(t)=bm 


FIGURE 8.37 Mass-spring-damper system of Exercise 8.2. 
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(b) Find the transfer function of the system relating the applied force to the 

Aco^ 

mass position. Express it in the form H(s)= s > +2 r 0) \ +0 / ■ What is the 
damping ratio £ for this mechanical system? What is its undamped natural 
frequency tn„? 


Answer: 


H(s) = 


1 

ms 2 +bs + k 
(1 /k)(k/m) 


s 2 + 


— SH 

m m 


The natural frequency is given by co 2 = - => co = J - . Note that the larger the 

n m n V m 

mass, the lower the undamped natural frequency; the stiffer the spring, the higher 
the undamped natural frequency. The damping ratio of the system is then 


c= 



For a given dashpot, the larger the mass and/or spring constant, the less 
damped the system will be. 

(c) Let the physical constants have numerical values m = 2kg, & = 8N/m, 
and b = 4N/ n / s . Suppose that the applied force is a step x(t) = 3 u(t) N. 
Compute and sketch the resulting mass position for all times. What is the 
mass position in steady-state? What is the percentage of the first overshoot 
in the step response? What is the ±5% settling time of the mass? (a nu- 
merical answer will suffice.) 


Answer: 

With the numerical values given, the damping ratio and undamped natural fre- 
quencies are 
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I f ^ 

The step input force is x{t) = 3 u(t) <->-■, Re{.v} >0. The Laplace transform of 
the step response is given by 

r(j)= — y-^ 5 

5(5 2 +25+4) 

_ -0.18750 + 70.10826 -0.18750 -jO. 10826 0.375 

s + l — j\f3 s + 1 + j \/3 s 

Taking the inverse Laplace transforms of the partial fractions and simplifying, 
we get 

y(t) = [(-0.18750 + y0.10826)e M+ '' /5> ' + (-0.18750 - j0A0S26)e ( ~ 1 ~ jS)t ^u(t)+ 0.375m(/) 

= 2e~' Re [(-0. 18750 + jO. 10826)^ ]«(/) + 0.375 u(t) 

= 2e~‘ [-0. 18750 cos yf3t -0.10826sin V3t jM(f) + 0.375w(t) m. 

This step response is plotted in Figure 8.38. The mass position in steady state 
is 0.375 m. 


(m) 


. v( 0 , 


9 10 

H s) 


FIGURE 8.38 Step response of the mass-spring- 
damper system of Exercise 8.2. 


The +5% settling time of the mass is found to be t,. = 2.65 s. The percentage 
of overshoot is 


& 0.5 n 

OS = 100e ^% = 100/^% = 16.3%. 
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Exercises 

Exercise 8.3 

Compute the 95% rise time t r and the +5% settling time t s of the step response of 
the system H(s) = ° 0 °°‘^ 1 , Re{.v} > -10. 


Answer: 



ON THE CD 


Exercise 8.4 

Compute the DC gain in decibels, the peak resonance in decibels, and the quality 
O of the second-order causal filter with transfer function H (s) = 2 1 „°°° . 

v ' j +2s + 100 

Exercise 8.5 

Compute the actual value of the first overshoot in the step response of the causal 
LTI system 


H(s) = 


5 

3s 2 + 3.v + 6 


Answer: 



ON THE CD 


Exercise 8.6 

Compute the group delay of a communication channel represented by the causal 
first-order system H(s ) = 1 ■, Re{.v} > -100. Compute the approximate value 

of the charmers delay at very low frequencies. 


Exercise 8.7 

Sketch the pole-zero plots in the .s- plane and the Bode plots (magnitude and phase) 
for the following systems. Specify whether the transfer functions have poles or 
zeros at infinity. 


(a) 

(b) 


H(s) = 


H(s) = 


100 (^- 20 ) 


(s + 5)(s + 100) 
-5 + 10 


Re {5} >-5 


5(0.0055 + 1) 


, Re{.v} > 0 
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(c) 


H(s) = 


s 2 + 305 + 900’ 


Re{.v} > -15 


Answer: 



ON THE CD 


Exercise 8.8 

Sketch the pole-zero plots in the .v- plane and the Bode plots (magnitude and phase) 
for the following systems. Specify if the transfer functions have poles or zeros at 
infinity. 


(a) 


H(s) = 


100(5-10) 

(5 + l)(.v + 10)(s + 100) ’ 


Re{.v} > -1 


(b) H(s) = 


(c) H(s) = 


.v + l 

5(0.015 + 1) 


, Re{.v} > 0 


5 ( 5 2 - 9 ) 


(5 + 100)(5 2 + 105 + 100) 


, Re{.v} > -5 


Exercise 8.9 

Consider the causal differential system described by 


1 d 2 y(t) 1 dy(t) dx(t) 

- - tt- + ~iz —r~ + y ( f ) = —r~ + x(t), 

4 Jr v2 dr dr 

with initial conditions ^ ’ = 3, y(0“) = 0 . Suppose that this system is subjected 
to the input signal x(t) = e 1 ' u(t) . 

(a) Find the system’s damping ratio f and undamped natural frequency ( 0 , r 
Compute the output of the system y(t ) for t > 0. Find the steady-state re- 
sponsey^XO? the transient response y n (t), the zero-input response y zi (t), and 
the zero-state response y~ s (t) for t > 0. 

(b) Plot y ss (t), y, r {t)> y Z i{t), an d y :s (t) for t > 0, all on the same figure using 
MATLAB or any other software of your choice. 

(c) Find the frequency response of the system and sketch its Bode plot. 


Answer: 
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Exercise 8.10 

Consider the causal differential system described by its direct form realization 
shown in Figure 8.39. 



FIGURE 8.39 System of Exercise 8.10. 


This system has initial conditions ’ =— 1, y(0 ) = 2. Suppose that the 

system is subjected to the unit step input signal x(t) = u(t ) . 

(a) Write the differential equation of the system. Find the system’s damping 
ratio £ and undamped natural frequency ( 0 „. Give the transfer function of 
the system and specify its ROC. Sketch its pole-zero plot. Is the system sta- 
ble? Justify. 

(b) Compute the step response of the system (including the effect of initial 
conditions), its steady-state response y ss (t), and its transient response y„(t) 
for t > 0. Identify the zero-state response and the zero-input response in the 
Laplace domain. 

(c) Compute the percentage of first overshoot in the step response of the sys- 
tem assumed this time to be initially at rest. 
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((Lecture 31: Review of Nodal Analysis and Mesh Analysis of Circuits)) 

T he Laplace transform is a very useful tool for analyzing linear time-invariant 
(LTI) electric circuits. It can be used to solve the differential equation relat- 
ing an input voltage or current signal to another output signal in the circuit. 
It can also be used to analyze the circuit directly in the Laplace domain, where cir- 
cuit components are replaced by their impedances seen as transfer functions. 
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REVIEW OF NODAL ANALYSIS AND 
MESH ANALYSIS OF CIRCUITS 


Let us quickly review some of the fundamentals of circuit analysis, such as nodal 
and mesh analysis based on Kirchhoff s current and voltage laws. 

Nodal Analysis 

Kirchhoff s Current Law (KCL) states that the sum of all currents entering a node 
is equal to zero. This law can be used to analyze a circuit by writing the current 
equations at the nodes (nodal analysis) and solving for the node voltages. Nodal 
analysis is usually applied when the unknowns are voltages. For a circuit with N 
nodes and N- 1 unknown node voltages, one needs to solve N- 1 nodal equations. 

Example 9.1: Suppose we have the resistor-inductor-capacitor (RLC) circuit of 

Figure 9.1 and we want to solve for the voltage across the resistor v(t). 



node 0: reference 


FIGURE 9.1 RLC circuit with a current source input. 


There are three nodes. The bottom one is taken to be the reference node (volt- 
age = 0). We can solve this circuit by writing the node equations at the other two 
nodes by applying KCL. 


Node 1: 


Node 2: 


^0 + }jl[v2^)-Vi(T)]r/T = ° 


di ( t ) 

i-^=y,(0-y,(0 


dv 2 { t) 1 

— v,( 

dt R 2 


^--v 2 (f) = 0 


dvAt) 1 
i (t) = C — - — -I — v At) 
dt R 2V> 


(9.1) 


(9.2) 
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Given the source current i(t), the voltage v(t) = v 2 (t) is obtained by solving 
the first-order differential Equation (9.2). Suppose there is an initial condition 
v(0~) on the capacitor voltage and the current is a unit step function. We use the 
unilateral Laplace transform to obtain 


CsV(s) - CV(0 ) + — 'V(s) = ^ ( 5 ) 

R 

V(s) = T ^ 0) + , v (0~) 


flCs + 1 
R 


- + - 


RCs + 1 
RC 


s(RCs + 1) RCs + 1 


v(O-) 




s s + 


1 


RC S+ RC 
Taking the inverse Laplace transform, we get 


(9.3) 


v(t) = R{ \ — e RC )u(t) + v ( 0 )e RC u(t ) 


(9.4) 


When voltage sources are present in the circuit, we can create “supemodes” 
around them. KCL applies to these supemodes. However, there are two node volt- 
ages associated with them, not just one. 


Example 9.2: Consider the RLC circuit of Figure 9.2. 




supemode 1 J (t ) 



nodi; 2 


C 


V 2 (0 


R > v{ ^ 


FIGURE 9.2 RLC circuit with voltage source input and supemode. 


Since there is one supemode for which we know that v l (t) = v s (t) and one 
ordinary node, we need only one node equation: 
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Node 1: 


}j'[v,(T)- v 2 (T)] t /r-C^ 


dt 

d\(t ) 


I wo-v.ca-c A , 


- + 


v(t) = LC 


c/ 2 v, (t) L dv (t) 


dt 2 


- + - 


R dt 


•— v (0 = 0 

i? 2 

1 dv 2 (t) 

R dt 

+ v 2 (0 


(9.5) 


Mesh Analysis 

Kirchhoff s Voltage Law (KVL) states that the sum of all voltages around a mesh 
(a loop that has no element within it) is equal to zero. This law can be used to an- 
alyze a circuit by writing the voltage equation for each mesh (mesh analysis) and 
solving for the mesh currents. Mesh analysis is usually applied when the u nk nowns 
are currents. 

Example 9.3: Suppose that we have the circuit in Figure 9.3 and we want to 

solve for the current i(t) = ( ( t) — i 2 (t) flowing in the capacitor. 



FIGURE 9.3 RLC circuit with voltage source input and 
mesh currents 


Mesh 1 : 


di,(t) 1 r< 

V s (t)-L^~- \ji 1 (T)-i 2 (T)]dT = 0 
1 d 2 i,(t) dv ( t ) 

^ c m ~ m+L ^ = dT 


(9.6) 


Mesh 2: ^ J - i 2 (r)\dz - Ri 2 (t ) = 0 


C 


1 diJt) 


(9.7) 
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We can transform these two equations to the Laplace domain before solving 
them for the mesh currents. Equation 9.6 becomes 

/jO)- I 2 (s) + LCs 2 I l (s) = CsF(s) 

(1 + LCs 2 )I l (s)-CsV s (s) = I 2 (s ) (9-8) 

and Equation 9.7 becomes 


I l {s)-I 2 (s) = RCsI 2 (s) 
(1 + RCs)I 2 (s) = I l (s) 


Substituting for I x (s) in Equation 9.8, we get 


[(1 + LCs 2 )( 1 + RCs)- l]/,(s) = CsF(s) 


I 2 (s) = 


CV(s) 

RLC 2 s 2 + LCs + RC 


and 


(\ + RCs)CF^ 
RLC 2 s 2 + LCs + RC 


(9.9) 


(9.10) 


(9.11) 


Now, we find the Laplace transform of the capacitor current to be 


I(s) = I l (s)-I 2 (s ) 

_ [(l + flCs)-l]CL ; (s) 
~ RLC 2 s 2 + LCs + RC 
CsV s {s) 

LCs~ + ^ s + 1 


(9.12) 


When current sources are present in the circuit, it actually simplifies the mesh 
analysis. 


Example 9.4: Consider the circuit shown in Figure 9.4. 

The current source specifies mesh current /,(?): 




(9.13) 
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L 



FIGURE 9.4 RLC circuit with current source input and mesh currents. 


and we only need the other mesh equation: 
Mesh 2: 


1 diAt) 

C sW 2W dt 


(9.14) 


which is a simple first-order equation expressed in the Laplace domain as 

(1 + RCs)I(s) = / (.s’) 


IM = 


l 

l + RCs 




(9.15) 



((Lecture 32: Transform Circuit Diagrams, Op-Amp Circuits)) 


TRANSFORM CIRCUIT DIAGRAMS: 
TRANSIENT AND STEADY-STATE ANALYSIS 


The nice thing about using the Laplace transform for circuit analysis is that we can 
replace each impedance in a circuit by its equivalent unilateral Laplace transform, 
and solve the circuit as if all the impedances were simple resistors. Initial condi- 
tions can also be treated easily as additional sources. 

Transform Circuit for Nodal Analysis 

As we have just seen in the previous section, nodal analysis can be used to analyze 
a circuit by writing the current equations at the nodes and solving for the node volt- 
ages. For a resistive network, the currents are usually written as the difference be- 
tween two voltages divided by the impedance (resistance). For a transform circuit, 
the same principle applies, although the impedance of each element is in general a 
function of the complex variable s. 
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Example 9.5: For the circuit shown in Figure 9.5, we want to solve for the volt- 

age v(t) from t = 0. Let us assume that there is an initial current i L ( 0“) in the 
inductor and an initial voltage v c (0“) in the capacitor. 


node 1 ^(t) 


node 2 1 ( t ) 



V(t) 


FIGURE 9.5 RLC circuit with a current source input. 


Using the unilateral Laplace transform, the inductor current can be written as 
Ls'7 L (s)-Li L (0~) = V L (s) 

W = T^ + -i L ( 0 ") ( 9 - 16 ) 

J-jS S 

and the corresponding circuit diagram combining the impedance Ls in the Laplace 
domain and the initial condition seen as a current source for the inductor is shown 
in Figure 9.6. 


-h(o-) 

S 




-e- 


Ls 


Vis) 


FIGURE 9.6 Equivalent circuit of 
inductor in the Laplace domain for 
nodal analysis. 


The capacitor’s voltage-current relationship in the Laplace domain is written as 
'7 c (s) = CsV c (s)-Cv c ( 0“) (9.17) 
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and the corresponding circuit diagram combining the impedance in the Laplace 
domain and the initial condition seen as a current source for the capacitor is given 
in Figure 9.7. 


Cv c (0 ) 


%(s) -► 


1 

Cs 



+ 





FIGURE 9.7 Equivalent circuit of 
the capacitor in the Laplace domain 
for nodal analysis. 


A resistor of resistance R is just an impedance R in the Laplace domain. With 
these impedances and equivalent current sources defined, the transform circuit is 
depicted in Figure 9.8. 


h ,(0 > 



FIGURE 9.8 Transform circuit diagram with current source. 


We can solve this circuit by writing the node equations. 


Node 1: 


o-) = o 

J-jS s 

=> % ( 5 ) = Isfl, ( 5 ) + % is) - Li L { 0 " ) 


(9.18) 
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Node 2: 


^( S )-Cs%(s)+Cv 2 ( 0-)--%(s) = 0 

K 


%(s) = 


R 

1 + RCs 


W + 


RCv 2 (0~) 
1 + RCs 


(9.19) 


Substituting this expression for^f.v) in Equation 9.18, we obtain 


% ( s ) = Ls'l (s) + *) (s) + 

1 7 sV 7 1 + RCs s 


RCv 2 ( 0 ") 
1 + RCs 


^(o-) 


(9.20) 


Assuming that the source current i (?) is a unit step, the voltage v(t) = v 2 (t) is 
obtained by substituting l/.v for 7 (.v) in Equation 9.19 first and by taking the in- 
verse Laplace transform: 


v(t) = R( 1-e RC )u(t) + v ( 0 )e RC u(t) (9.21) 

The voltage^s) is obtained in a similar way by using Equation 9.20. 

t t 

v, (0 = L[ 1 - i L ( 0“ )]5( t) + R( 1 - )u(t) + v( 0“ )e~^u(t) (9.22) 

Notice that there is an impulse in the node 1 voltage response, which is not sur- 
prising since the voltage across the inductor is proportional to the derivative of the 
unit step current. 

Example 9.6: Recall that when voltage sources are present in the circuit, we can 

create “supemodes” around them, as shown in Figure 9.9. 



FIGURE 9.9 Transform circuit diagram for a circuit with a supernode. 
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We have one supemode for which we know that v^t) = v ( t ) and one ordinary 
node; thus, we need only one node equation: 


Node 2: 


j- [V 0) - % (5)] + X - i L (O' ) - Cs% ( 5 ) + Cv c (0~)-j%(s) = 0 
=t> LCs 2 % (s) + —s‘V 2 (s) + ‘V 1 (s) = “V s (v) + Li L ( 0“ ) + LCsv c ( 0“ ) 

A 


%(S) = 


1 y (s) + LCsv c (Q-) + Li L (Q-) 

LCs 2 + -s + 1 LCs 2 +—s + 1 

R R 


(9.23) 


Transform Circuit for Mesh Analysis 

Mesh analysis can be used to analyze a circuit by applying KVL around the circuit 
meshes. For a resistive network, the voltages are usually written as the mesh 
current times the resistances. The same principle applies for a transform circuit, 
although in this case the impedance of each element is in general a function of the 
Laplace variable. 

Example 9.7: Suppose that we have the circuit in Figure 9.10 and we want to 

solve for the current ijt) = ;'(?) — ;' 2 (t) in the capacitor. Let us assume that there 
is an initial current ^(0“) in the inductor and an initial voltage v c (0“) in the 
capacitor. 



FIGURE 9.10 RLC circuit with voltage source input 
and mesh currents. 


Using the unilateral Laplace transform, the inductor voltage can be written as 

%(s) = LsV L (s)-Li L { 0") (9.24) 

The corresponding circuit diagram combining the impedance Ls in the Laplace 
domain and the initial condition seen as a voltage source for the inductor is shown 
in Figure 9.1 1. 
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FIGURE 9.1 1 Equivalent circuit of inductor 
in the Laplace domain for mesh analysis. 


The capacitor voltage-current relationship in the Laplace domain is written as 

W = ^ W+ s Vc((n (9 ' 25) 

The corresponding circuit diagram combining the impedance ^ in the Laplace 
domain and the initial condition seen as a voltage source for the capacitor is as 
shown in Figure 9. 12. 



t(v) 


FIGURE 9.12 Equivalent circuit of 
capacitor in the Laplace domain for 
mesh analysis. 


With these impedances and equivalent current sources defined, the transform 
circuit can be depicted as in Figure 9.13. 


ns) 



+ 


FIGURE 9.13 Transform RLC circuit with voltage sources 
for the input and initial conditions and with mesh currents 
in the Laplace domain. 
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Suppose we want to find the capacitor current i c (t) = i x (t)-i 2 (t). We can 
solve this circuit by applying KVL to each mesh. 


Mesh 1 : (5) - Ls'l x (, s ) + Li L ( 0“ ) - Y> x (s) - f ) 1 (s)] - “ v c (° ) = 0 

=> ? 2 (, s ) = -CsV, (s) + (1 + LCs 2 )7, (, s ) + Cv c (O' ) - LCsi, (O' ) (9.26) 


Mesh 2 : (5) - 7, (5)] + ^ v c (0~ ) - R f ! 1 (s) = 0 

=> ^(s) = (l + RCs)^ 2 (s)-Cv e (0-) (9.27) 

Substituting the expression for *? 2 (s) in Equation 9.18, we obtain 


[l-(l + i?Cs)(l + LCs 2 )]^,(j) 
(1 + RCs) 


W- 


(1 + RCs)Cs% (s) + RC 2 sv c (0" ) - (1 + RCs)LCsi L (0 ) 
(\ + RCs)Li,(() ) Cv c (0 ) 


R(LCs-+^s + 1) 


t(s) + 


R(LCs 2 + ^s + 1) (LCs 2 +^s + l) 


(9.28) 


Substituting back into Equation 9.7, we obtain 


^ 2 (s) = 


R(LCs 2 + ^s + 1) 


%(s) + 


Li ,(()-) 

R(LCs 2 + jis + 1) 


LCv c { 0 ).v 
R(LCs 2 +^s + 1) 


(9.29) 


Finally, we can solve for the capacitor current: 


'){s) = ') l (s)-') 1 (s) = 


Cs 

(LCs 2 +ks + 1) 


w+ 


CLi t ( 0 ).v 
(LC5 2 + 4.v + i) 


Cv c (0~)(l + ^) 
(LCs 2 +^s + 1) 


(9.30) 


OPERATIONAL AMPLIFIER CIRCUITS 


The operational amplifier (op-amp) is an important building block in analog elec- 
tronics, notably in the design of active filters. The ideal op-amp is a linear differ- 
ential amplifier with infinite input impedance, zero output impedance, and a gain 
A tending to infinity. A schematic of the equivalent circuit of an ideal op-amp is 
shown in Figure 9. 14. 

Because of its very high gain, the op-amp is meant to be used in a feedback 
configuration using additional passive components. Such circuits can implement 
various types of transfer functions, notably typical first-order leads and lags, and 
second-order overdamped an underdamped transfer functions. 
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FIGURE 9.14 Equivalent circuit of an ideal op-amp. 


Example 9.8: Consider the causal op-amp circuit initially at rest depicted in Fig- 

ure 9.15. Its LTI circuit model with a voltage-controlled source is also given in the 
figure. Let us transform the circuit in the Laplace domain and find the transfer 
function H A (s) = V out (s)/V in (s ) . Then, we will let the op-amp gain ^4— >+°° to 
obtain the ideal transfer function H(s) = lim H A (s ) . 


L, 



FIGURE 9.15 Op-amp circuit and its equivalent circuit. 


The Laplace domain circuit is shown in Figure 9.16. 

There are two supemodes for which the nodal voltages are given by the source 
voltages. The remaining nodal equation is obtained as follows: 

v^-vM , -Ay»-y t (s ) _ 0 

R 2 L 2 s R, L { s 


(9.31) 
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FIGURE 9.16 Laplace transform circuit. 


where R t ||^||V = <*4+* = and *2 || V = are the resulting 

impedances of the parallel connections of the individual impedances. Simplifying 
the above equation, we get 

+ R + L 2 s y ^ ) = 0 (9 32) 

Thus, the transfer function between the input voltage and the node voltage is 
given by 


R^+L ? s (A + L,Cs~ + L,s + R , ) 

— —V- (s)— — 1 — 

R 2 L 2 s m l R^s 



and the transfer function between the input voltage and the output voltage can be 
obtained: 


„ j<s) = fi>) = Z^W = -AKM^+Z,.,) 

VJs) V in (s) R 2 L 2 s(A + l)(R l L i Cs 2 + L l s + R l ) + R l L 1 s(R 2 + L 2 s) 

The ideal transfer function is obtained as the limit of Equation 9.34 as the op- 
amp gain tends to infinity: 

L,ll + L vl 

BW = lim H a (,) = = LJ 

"" S 2 L ! (fi l L 1 C S - + L |S + « l ) MiiCs » + |L., + 1) 


(9.35) 
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This is a second-order system with negative DC gain and one zero z, = - 
Assume that the desired circuit must have a DC gain of-50, one zero at -1 , and two 
complex conjugate poles with (O n = 10 rad/s, £ = 0.5 . Let L { = 10 H . Let us find 
the values of the remaining circuit components L 2 , R v R 2 ,C . These component 
values are obtained by setting 


H(s) = -50 


5 + 1 

0.01s 2 + 0.1s + 1 




s + 1) 


(LjCs 2 + 


^s + l) 


(9.36) 


which yields L 2 = 0.2 H, R t = 100 Q, R 2 = 0.2 Q, C = 0.001 F. With these values, 

jco+l 

the frequency response of the op-amp circuit is H(jco) = -50 o.oKyrar+o.Kjwj+i • Fig- 
ure 9.17 shows the Bode plot of the circuit with the phase expressed in degrees. 



FIGURE 9.17 Bode plot of an op-amp circuit. 
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SUMMARY 


This chapter was a brief overview of the analysis of LTI circuits using the Laplace 

transform. 

■ The Laplace transform can be used to solve the differential equation relating an 
input voltage or current signal to another output signal in the circuit. 

■ The Laplace transform can also be used to analyze the circuit directly in the 
Laplace domain. Circuit components are replaced by their impedances, and 
Kirchhoff s laws are applied to get algebraic equations involving impedances 
and signals in the Laplace domain. 

■ The ideal operational amplifier was described, and an active filter op-amp cir- 
cuit example was solved to illustrate the use of op-amps in realizing transfer 
functions. 


TO PROBE FURTHER 


There are many references on circuit analysis. See, for example, Johnson, Johnson, 
Hilbum, and Scott, 1997. For an in-depth treatment of op-amp circuits, see Schau- 
mann and Van Valkenburg, 2001. 


EXERCISES 


Exercises with Solutions 

Exercise 9.1 

The circuit in Figure 9.18 has initial conditions on the capacitor v c (0“) and in- 
ductor i L { 0“). 


MO 



R? 

-AAA r 


v (0 


FIGURE 9.18 Circuit of Exercise 9.1. 


(a) Transform the circuit using the unilateral Laplace transform. 
Answer: 

The transform circuit is given in Figure 9. 19. 
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t(s) 



V(s) 


ii. <0 ) 


FIGURE 9.19 Transform circuit of Exercise 9.1. 


(b) Find the unilateral Laplace transform V(s) of v(t). 
Answer: 

Let us use mesh analysis. For mesh 1, 

s Ls 

=> V 2 (s) = -CsV s (s)+Cv c ( 0") + (1 + R l Cs)'),(s) 


For mesh 2, 


-^ r ['? l (s)- / ? 2 (s)] + -v c (0 )+ Li,(0 )-(R 2 +Ls) / ? 2 (s) = 0 

CS S 

=> f ! x (s) = (1 + R 2 Cs + LCs 2 y) 2 (s) - Cv c (O' ) - LCsi L (0" ) 
Substituting, we obtain 

0 2 (s) = -CsV s (s) + Cv c ( 0") + (1 + /?,Cj)[(1 + R 2 Cs + LCs 2 )'7 2 (s)-Cv c ( 0~)- 
LCsi L ( O')]. 

Solving for 7 2 (s), we get 

0 (s) = W | L(1 + RCs)^ (0~ ) + R x Cv c (0~ ) 

LR x Cs + (R^R { C + lA)s + R x -T R 2 LR x Cs + (R 2 R X C + L)^ + + 7L, 

Finally, the unilateral Laplace transform of the output voltage is given by 


V(s) = Ls'? 1 (s) — i L (0 ) = 


Ls'PJs) 


, Lsa + RfisVAOn + ^LCsvAO-) : m . 

+ l L V U 


LR x Cs + + R\ + LR x Cs + (/? 2 ^iC 


(c) Give the transfer function ^(s) from the source voltage *1/ S {s) to the output 
voltage ^(s). What type of filter is it (lowpass, highpass, bandpass)? As- 
suming that the poles of “%(s) are complex, find expressions for its un- 
damped natural frequency co„ and damping ratio £. 
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Answer: 

Notice that the transfer function from the source voltage to the output voltage is 
bandpass. Its gain at DC and infinite frequencies is 0. The transfer function 1^(s) 
from the source voltage V/s) to the output voltage ^(s) is given by 

^ (s) = ^l = ^ 

LR { Cs 2 + (^R 2 R i C + L)s + /?j + R 2 

Its undamped natural frequency is (0„ = J'jpp- ■ The damping ratio is com- 
puted from 




+ L 

R^R.C + L y LR. C 

oC = — , 

LR { C 2 R,+R 2 

\ LR,C 


R 2 R t C + L 
2 y f{R l + R 2 )LR t C 


(d) Assume that R t = 100Q, R 2 = 100 Q, co n = 10. Find the values of L and C 
to get Butterworth poles. 


Answer: 

The Butterworth poles are for 

„ 1 R,R,C + L 10000 C + L _ r— 

C = —j= = — , = — , = => 200 \l LC = 10000C + L 

V2 2^1 (R t + R 2 )LR t C 2V20000 LC 

I 2 1 

Furthermore, co n - 10 = J— => LC = — , and substituting in the previous 
equation, we get 


200 


1 =10000C+- 1 


y/50 50 C 

0 = 500000C 2 - 200 V50C + 1 


0 = C- 


2V50 


c + 


1 


0 = C 2 - 


5000 500000 

2 „ 1 

c+ 


100 V50 
100^ F 


500000 


=> c = 
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Finally, 


L = 


1 

50 C 


50 


100 V50 


100 

V50 


H 


Exercises 

Exercise 9.2 

The circuit in Figure 9.20 has initial conditions on its capacitor v c (0“) and induc- 
tor i L ( 0“). 



(a) Transform the circuit using the unilateral Laplace transform. 

(b) Find the unilateral Laplace transform f'(.v) of v(t). 

(c) Give the transfer function 1?(s) from the source voltage V s (s) to the output 
voltage *l/(s) (it should be second-order). What type of filter is it (lowpass, 
highpass, bandpass)? Assuming that the poles of^(s)are complex, find ex- 
pressions for its undamped natural frequency (O n and damping ratio f. 

Exercise 9.3 

Consider the causal ideal op-amp circuit in Figure 9.21 (initially at rest), which im- 
plements a lowpass filter. 



FIGURE 9.21 Op-amp filter circuit of Exercise 9.3. 
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(a) Sketch the LTI model of the circuit with a voltage-controlled source rep- 
resenting the output of the op-amp, assuming that its input impedance is in- 
finite. Also, assume for this part that the op-amp gain A is finite. 

(b) Transform the circuit using the Laplace transform and find the transfer 

function H A (s ) = V out (s)/V in (s). Then, let the op-amp gain to ob- 

tain the transfer function H(s) = lim H A (s) . 

A — >+°o 

(c) Find expressions for the circuit’s undamped natural frequency and damp- 
ing ratio. 


Answer: 



ON THE CD 


Exercise 9.4 

Consider the causal op-amp circuit initially at rest depicted in Figure 9.22. Its LTI 
circuit model with a voltage-controlled source is also given in the figure. 


-^1 



(a) Transform the circuit using the Laplace transform and find the transfer 
function H A (s) = V out (s)/V in (s). Then, let the op-amp gain A — > +°° to ob- 
tain the ideal transfer function H{s ) = lim H ,(.v) . 

A — >+00 
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(b) Assume that the transfer function H^s) = — ^ has a DC gain of -50 and 
that H(s ) has one zero at 0 and two complex conjugate poles with 
co n = 10 rad/s, C = 0.5. Let L, = 10 FL Find the values of the remaining 
circuit components R l ,R 2 ,C. 

(c) Give the frequency response of H(s) and sketch its Bode plot. 

Exercise 9.5 

The circuit in Figure 9.23 has initial conditions on the capacitor v c (0“) and in- 
ductor z' £ (0“). 


v ,(0 





>’(/) 


FIGURE 9.23 Circuit of Exercise 9.5. 

(a) Transform the circuit using the unilateral Laplace transform. 

(b) Find the unilateral Laplace transform of v(t). 

(c) Sketch the Bode plot (magnitude and phase) of the frequency response 
from the input voltage < V s ( j( 0 ) to the output voltage 'P(jO)). Assume that 
the initial conditions on the capacitor and the inductor are 0. Use the 

numerical values R { = 1 Q, R 2 = ^ Q, L = ^ H, C = 1 F . 


Answer: 
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((Lecture 33: State Models of Continuous-Time LTI Systems)) 


I n Chapter 3 we studied an important class of continuous-time linear time- 
invariant (LTI) systems defined by linear, causal constant-coefficient differen- 
tial equations. For a system described by an /V^'-ordcr differential equation, it is 
always possible to find a set of N first-order differential equations and an output 
equation describing the same input-output relationship. These N first-order differ- 
ential equations are called the state equations of the system. The states are the N 
variables seen as outputs of the state equations. 

The concept of state is directly applicable to certain types of engineering sys- 
tems such as linear circuits and mechanical systems. The state variables in a circuit 
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are the capacitor charges (or equivalently the voltages since q = Cv) and the in- 
ductor currents. In a mechanical system, the state variables are generally the posi- 
tion and velocity of a body. 

Before we move on, an important word on notation: for state-space systems, 
the input signal is conventionally written as u(t) (not to be confused with the unit 
step) instead of x(t), as the latter is used for the vector of state variables. Hence, in 
this chapter we will use q(t) to denote the unit step signal. 


STATE MODELS OF CONTINUOUS-TIME LTI 
DIFFERENTIAL SYSTEMS 


Consider the general /V'^-ordcr causal linear constant-coefficient differential equa- 
tion with M <N: 




d k y{t) 

dt k 




d k u(t ) 
d? ’ 


( 10 . 1 ) 


which can be expanded to 


d N y(t) 

dt N 


• + a. 


dy(t ) 
dt 


+ a 0 y(t ) = b x 


d M u(t) 

dt M 


+ ■ ■ ■ + b. 


du{t) 

dt 


+ b 0 u{t). (10.2) 


Controllable Canonical Realization 


We can derive a state-space model for the system in Equation 10. 1 by first finding 
its controllable canonical form (or direct form) realization. The idea is to take the 
intermediate variable w in the direct form realization introduced in Chapter 7, and 
its successive N- 1 derivatives, as state variables. Recall that the Laplace variable 
,v represents the differentiation operator — , and its inverse s' 1 is the integration op- 
erator. Let a N = 1 without loss of generality. Taking the Laplace transform on both 
sides of the differential Equation 10.2, we obtain the transfer function (with the re- 
gion of convergence [ROC] a right half-plane to the right of the rightmost pole): 


5 >* 




U(s) 


,a,s 


b S M +b s M ~ l H \-b 

S N + U n _^S N 1 H h CLq 


(10.3) 
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A controllable canonical realization can be obtained by considering the trans- 
fer function H(s) as a cascade of two subsystems as shown in Figure 10.1. 



FIGURE 10.1 Transfer function as a cascade of two LTI subsystems. 


The input-output system equation of the first subsystem is 

s N W ( s ) = -a N _\S N ~ l W ( s ) a { sW ( s ) - a 0 W (s) + U(s), (10.4) 

which, as seen in Chapter 7, corresponds to feedback loops around a chain of inte- 
grators. For the second subsystem we have 

Y ( s ) = b M s M W ( s ) + b M _ l s M ~ l W (s)H h b { sW ( s ) + b 0 W ( s ). (10.5) 

The controllable canonical realization is then (assuming M = N without loss of 
generality) as shown in Figure 10.2. 



FIGURE 10.2 Controllable canonical realization of transfer function. 
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Zj(5) := W ( 5 ) 
X 2 (s):=sW(s ) 
XJs) := s 2 W(s ) 


X N (s):=s N - l W(s) 


. r N 

From this block diagram, define the state variables {x, j as follows. 
dx t (t) 


dt 

dx 2 (t) 
dt 

dx 3 (t) 

dt 

dx N (t) 

dt 


= x 2 (t) 


= x 3 (t) 


= x 4 (t) 


= —a 0 x t (t)- a x x 2 (t)- a 2 x 3 (f) ci n-\ x n (■ t) + u(t ) (10.6) 


The state equations on the right can be rewritten in vector form: 


x,(0 


" 0 

1 

0 

0 

XjO 0 


"0 

X 2 (t) 


0 

0 

0 

0 

x 2 (t) 


0 


= 






+ 


%-l (t) 


0 

0 

0 

1 

X N _\(t) 


0 

_ x N (t) _ 



— Oj 

~ a N - 2 

~ a N- 1 _ 

_ x N (t) _ 


1 


u(t). 


(10.7) 


where the constant matrices A and B are defined in Equation 10.7 and the notation 
x ; (t) := is used for the time derivative. Let the state vector (or state ) be defined 
as 


x(t) \= 


x, (t) 
x 2 (t) 

%_i (0 

. x N (t) 


(10.8) 


The space R in which the state evolves is called the state space. Then the 
state equation can be written as 


x(t) = A x(t) + Bu(t). 


(10.9) 



State Models of Continuous-Time LTI Systems 355 


From the block diagram in Figure 10.2, the output equation relating the output 
y(t) to the state vector can be written as follows: 

y(t) = [b 0 -a 0 b N b x -a x b N ••• Vi -%-A/]*(0 + V u(t) 

~c~ ^ D 

= Cx(t) + Du(t ) (10.10) 

If H(s) is strictly proper, that is, if M<N, then the output equation becomes 
y(f) = K b { ••• b N _ x \x{t) 

c 

= Cx(t) (10.11) 

Note that the input has no direct path to the output in this case, as b N = 0 in 
Figure 10.2 and D = 0 in the state model. The order of the state-space system de- 
fined by Equations 10.9 and 10.10 is N, the dimension of the state vector. 


Observable Canonical Realization 


We now derive a state-space model for the system of Equation 10.2 by first find- 
ing its observable canonical form realization. The idea is to write the transfer func- 
tion H(s) as a rational function of .v 


H(s) = 


h S M ~ N + h v 


M-N - 1 


H h b Q S 


-N 


1 + a N-l s 1 H 1- a 0 s N 


( 10 . 12 ) 


Assume without loss of generality that M - N (if they are not equal, then just 
set b N = Vi = ’ • • = b M+ , = 0) so that 


H(s) = 


b N +b N _ x s 1 +--- + /j 0 5' N 
I + Oat-A -1 H 


(10.13) 


Then, the input-output relationship between U(s) and Y(s) can be written as 

T(5) = & A ,[/(' s ) + [ViE(-s)-« W -iT(' s )]' s ~ 1+ [V2E(5)-a W -2T(i)]T 2 + ■•• + [ ^(/(sf-flofis)]*"". (10.14) 


The interpretation is that the output is a linear combination of successive inte- 
grals of the output and the input. The block diagram for the observable canonical 
form consists of a chain of N integrators with summing junctions at the input of 
each integrator as shown in Figure 10.3. 
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U( S ) 



The state variables are defined as the integrator outputs, which gives us 


.sXi ( 5 ) = -a 0 X N (, s ) + (b 0 - a 0 b N )U ( 5 ) 
sX 2 (s) = X, (s) - ai X N (s) + ( b , - a t b N )U(s) 
sX 3 (s)= X 2 (s)-a 2 X N (s)+(b 2 - a 2 b N )U(s ) 


dXj (0 
dt 

dx 2 (t) 

dt 

dx 3 (t) 

dt 


= -a a x N ( t) + (b 0 - a 0 b N )u{t) 

= x t - a t x N p) + (6, - a,£> w )u(t) 

= x 2 (t)~ a 2 x N (t) + (b 2 - a 2 b N )u(t) 


sX N (s) = X N _ t ( 5 ) - a N _ t X N (s) + (V. “ a «-i b N ) u M dx nJ t '> - Xn i ( f ) _ a N1 x N (t) + - a N _ l b N )u{t) (10.15) 

at 


The state equations on the right can be rewritten in vector form: 


•TO 0 


"0 

0 • 

■ 0 

~ a o 

T (?) 


b o 

1 

0 

<3 

1 

x 2 {t) 



1 

0 

0 

~ a l 

x 2 (t) 

+ 

b i 


%_i(0 


0 

0 

0 

~ a N- 2 

%- 1(0 


b N - 2 

_ a N-2 b N 

. X N {t) _ 


0 

0 • 

■ 1 

~ a N - 1 _ 

. x N {t) _ 


_V 1 

~ a N-\ b N _ 


■v v 

A B 


(10.16) 
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The output equation is simply 

y(t) = [0 ••• 0 1 ]x(t)+b„u(t) 

~c~ ' ^ 

= Cx(t) + Du(t ) (10.17) 

If H(s) is strictly proper, then, again b N = 0 and hence D = 0. 

Remarks: 

■ A general linear time-invariant state-space system has the form x(t) = Ax(t ) + 
Bu(t),y(t ) = Cx(t) + Du(t) which is often denoted as (A, B, C, D). 

■ The matrices A, B, C, D are called state-space matrices. 

■ Given a system defined by a proper rational transfer function, a state-space de- 
scription of it is not unique, as we have shown that there exist at least two: the 
controllable and observable canonical realizations. It can be shown that there 
exist infinitely many state-space realizations, as we will find out later. 

MATLAB can be used to get a canonical state-space realization of a transfer 
g - j function. For example, the following M-file found on the CD-ROM in D:\Chap- 
on the cd terlO\realization.m generates the controllable canonical realization. 

%% realization . m State-space realization of a transfer function 
% transfer function numerator and denominator 
num=[1 100]; 
den=[ 1 11 10]; 

% state-space realization 
]A,B,C,D]=tf2ss(num,den) 

Circuit Example 

We will derive controllable and observable canonical state-space representations, and 
a direct state-space representation for the second-order resistor-inductor- 
capacitor ( RLC) circuit of Figure 10.4. The state variables are the inductor current i,(t) 
and the capacitor voltage v c (t). Suppose that we want to solve for the voltage v c (t). 


f(0 



L 

UWAj 

i L (l) C A(0 


R 


FIGURE 10.4 RLC circuit. 
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Direct State-Space Realization 


Left mesh: 


v s (t)-L < ^P--v c (t) = 0 


di L (t) 

dt 


dt 

= -T v c(0 + tV s 0) 


L 


L 


(10.18) 


Node: 


i l (0 ~ C dXc , J ) ~ ^ v c (0 = 0 

ut /v 


Jv c (f ) _ 1 . 
C 




AC 


(10.19) 


Letting x x (t)\=v c {t), x 2 (t):=i L (t), u(t):=v s (t), y(t):=v c (t), we can write 
the system in state-space form: 


x x (t) 

x 2 (t) 


1 

1 ' 




”^c 

1 

C 

x,(0 

_X 2 (0. 

+ 

" 0 " 

1 

L 

0 



_L_ 

B 


A 


with the output equation 


y(t) = [l 0] 


x, (t) 

X 2 (t)_' 


( 10 . 20 ) 


( 10 . 21 ) 


Controllable Canonical State-Space Realization 

Combining Equations 10.18 and 10.19, we get the second-order differential equation 


d 1 2 v c (t ) 
dt 2 


1 di L (t ) 1 dv c (t ) 

C dt RC dt 


1 

LC 


v c (t) + 


1 

LC 


v,(0- 


1 dv c ( t ) 


( 10 . 22 ) 


Upon rearranging, we obtain 


d 2 v r (t) 1 dv r {t) 1 

+ — + v c(0 

dt 2 RC dt LC 


1 

LC 


v,(0, 


(10.23) 
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which in the Laplace domain becomes 


5' 2 V r c (5)+ — 5^(5) + —!— V c (s) = ~ — V (s) 

c RC c LC c LC S 

and has the controllable canonical realization given in Figure 10.5. 


(10.24) 



V c (s) 


*- 



FIGURE 10.5 Controllable canonical realization of a circuit system. 


Let u(t ) := vjt), y(t ) := v c (f). The controllable canonical state-space form is 
then given by 


4,(0 


_X 2 (0_ 



0 1 

1 l_ 

LC RC 





Xi(t) 

+ 

" 0 " 



1 





u(t). 


and the output equation has the form 

y(t) = 


— 0 

Xi(t) 

.LC 

_x 2 (t)_ 


(10.25) 


(10.26) 


Observable Canonical State-Space Realization 

Equation 10.24 is divided by s 2 on both sides to obtain 


V c (s) + 


1 


V c (,s) + 

RCs c LCs 


X -V c {s) = -^V s {s), 


LCs 


(10.27) 
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which is rewritten as 


V c( s ) = —^T V c( s ) + \ 
RCs s 


— V s (s) — -L c (s) 
LC s LC c 


(10.28) 


This equation is represented by the block diagram in Figure 10.6. 



Let u(t):=v s (t), y(t)\=v c {t). The observable canonical state-space realiza- 
tion is given by 


*i(t) 

x 2 (t) 


1 1 




0 

LC 

*i(0 

+ 

1 

LC 

i — t- 

_x 2 (t)_ 


0 

L RC. 



B # 


A 

and the output equation is simply 


y(t) = [o 1 ] 


x t (t) 

x 2 {t)_' 


(10.29) 


c 


(10.30) 
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((Lecture 34: Zero-State Response and Zero-Input Response)) 


ZERO-STATE RESPONSE AND ZERO-INPUT RESPONSE OF A 
CONTINUOUS-TIME STATE-SPACE SYSTEM 


Recall that the response of a system with nonzero initial conditions is composed of 
a zero-state response due to the input signal only and a zero-input response due to 
the initial conditions only. For a state-space system, the initial conditions are cap- 
tured in the initial state x(0). 

Zero-Input Response 

Consider the following general continuous-time, single-input, single-output, N th - 
order LTI state-space system: 

x(t) = Ax(t) + Bu(t) 

y(t) = Cx(t) + Du(t), (10.31) 

where *(r)eR J '\;y(r)eR,w(f)eR, and 

The zero-input response y.,(f) is the response to an initial state x(0) = x 0 only. 
The state equation is then 


x(t) = Ax(t). (10.32) 

The solution to this homogeneous state equation involves the matrix exponen- 
tial function, which is defined as a power series of a square matrix A e M Vx ' v : 


e A I N + A H — A -l — A 3 H 1 — A 1 '- 1 — , (10.33) 

N 2 3! k\ 

where I N is the N xN identity matrix. It can be shown that this power series con- 
verges for any matrix A. Note that this definition generalizes the definition of the 
scalar exponential function How do we compute e A l One way is to 

diagonalize the matrix A and take the exponential of the eigenvalues. Specifically, 
if matrix T e C A,X ' V diagonalizes A, that is, 


A, 0 
0 A, 


0 

0 


= T~'AT 


0 • • • A w 


(10.34) 


0 
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where A, e C is the i' h eigenvalue (all eigenvalues are assumed to be distinct) of 
the matrix A, then the exponential of A is given by 


1 


1 


1 


e = e A ‘ = /„ + T AT~ + -TA^T 1 + —TA T + • ■ ■ + — TA T +■■■ 


= T 


3! 

I N + A + -A 2 + — A 3 + ••• + — A* + ••■ 
N 2 3! kl 


kl 


= Te A T~ l 


= T 


e M 0 

0 

0 0 


0 


(10.35) 


The matrix of eigenvectors of A is diagonalizing, so we can use it as matrix T. 
The time-dependent matrix exponential e At is simply 


At T AT t rp 

e = e = 1 


e ^ 0 

0 e* 


0 

0 


0 0 • 

Now consider the vector-valued function of time 


T~\ 


(10.36) 


x(t) = e A, x 0 , 


(10.37) 


where x(t) e M A and x(0) = x 0 . The claim is that this function is the state response 
of the system to the initial state for t > 0 . To show this, simply substitute Equation 
10.37 into the left-hand side of Equation 10.32: 


dx(t) d 


- = — e x 0 = — 
dt dt dt 


I +At + -A 2 t 2 +■ 
2 


a+a 2 t+-aY +■ 
2 


= A 


I , + At + -A 2 t 2 + ■ 

n 2 


= Ae A, x 0 = Ax(t) 


(10.38) 
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Therefore, the zero-input state response is as given in Equation 10.37 for t > 0, 
and the corresponding zero-input response is 

y zi (t) = Ce A, x 0 q(t), ( 10 . 39 ) 

where q(t) is the unit step signal. 


Example 10.1: Let us revisit the circuit example with its first physically moti- 

vated state-space representation: 


■*i (t) 
x 2 {t) 


1 J_ 

~RC C 

-- 0 

L 


x x (t) 
x 2 (t ) 


+ 



u(t). 


B 


( 10 . 40 ) 


y(0 = [i 


o] 


*l( t) 

x 2 {t)_' 


( 10 . 41 ) 


Suppose R = 1 Q, L = 1 H, C = 1 F, the initial capacitor voltage is x^O) = 10 V, 
and the initial inductor current is x 2 (0) = 0 A. With these numerical values, the state 
equation becomes 


V 

= 

1 f 

"V 

+ 

" 0 " 

x 2 _ 


-1 0 

*2. 


1 


A B 


( 10 . 42 ) 


We want to find the zero-input state response of the circuit. We first compute 
the eigenvalues of A: 


det(A/ 2 - A) = det 


A + 1 
1 


-1 

A 


= 0 


+A + 1 = 0 


A 


1,2 




( 10 . 43 ) 
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Then, the corresponding eigenvectors v, , v 2 are computed: 


(Aj / 2 — A)Vj = 0 

1 .73 

- + j — -1 

2 2 




i .7 


1 

- — + — 

_ 


2 2 


V, , 


1 .73 


K 11 

= 

2 _7 1~ 


_ V 12_ 


1 


IV 


" 0 " 

L V 12. 


0 


(A 2 / 2 — A)v 2 =0 
2 J 2 


1 


1 .73 

~ 2 _ 7 1 T. 


[ V 21 


" 0 " 

_ V 22 _ 


0 


r n 


1 .73" 

V 21 


“ + J—— 


— 

2 2 

_ V 22 _ 


1 


Letting 


and 



1 73 1 73 

— J — — + J — 

2 2 2 2 

1 1 


1 .73 
2 +7 lT 

0 


0 

1 73 

T -2 — 


( 10 . 44 ) 


( 10 . 45 ) 


( 10 . 46 ) 


we check that T AT 1 = A : 
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T AT- 


x(t) = 


1 75 1 75 

— J — - + j — 

2 2 2 2 

1 1 


1 i .75 

-—+ j— — 

0 

"1 

.75 

i .75" 

2 2 

i .75 
~2 _; 7T_ 
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1 .75 

2 _7 T" . 


A 
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(10.47) 


Finally, the zero-input state response is calculated using Equations 10.36 and 
10.37: 


e At x n = Te A, T- l x n 
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(10.48) 
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20 

75 



f 
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i . 75 75 75 

— sin — t cos — 




2 


\ 

t 


Zero-State Response 

The zero-state response y (t) is the response of the system to the input only ( ini- 
tial rest). A recursive solution cannot be obtained in continuous time, so we resort 
to the impulse response technique. Let u(t ) = 8(t) in Equation 1 0.3 1 to find the im- 
pulse response. 


x(t) = A x(t) + Bd(t ) 
h{t) = Cx(t ) + D8(t ) 


(10.49) 


Integrate the state equation in Equation 10.49 from 1 = 0 to t = 0 + to “get rid 
of the impulse” and obtain 


x(0 + )-x(0~) = B 
=o 

x(0 + ) = B. (10.50) 

Thus, from ! = 0 + , we have a zero-input (autonomous) state equation 
x(t) = Ax(t) to solve for t > 0 with the initial condition obtained in Equation 
10.50. The solution as given by Equation 10.37 is 

x(t) = e Al Bq(t) (10.51) 

and hence, the impulse response of the state-space system is given by 

h(t) = Ce A 'Bq(t) + D8(t). (10.52) 

The zero-state response is just the convolution of the input with the impulse re- 
sponse of the system. Assume that the input starts at t = 0, that is, u(t) = 0, t < 0: 

Too 

T7 f )= J h(T)u(t-T)dT 

Too 

= J ( Ce Ar Bq{T) + D8{T))u{t-T)dT 

t 

= J Ce Ar Bu(t - T)dT + Du{t ) 

o 


(10.53) 
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((Lecture 35: Laplace Transform Solution of State-Space Systems)) 


LAPLACE-TRANSFORM SOLUTION FOR CONTINUOUS-TIME 
STATE-SPACE SYSTEMS 


Consider the state-space system of Equation 10.3 1 with initial state x(0 ) = x 0 de- 
picted in Figure 10.7. 


u(t) 

x - Ax + Bit 

m 


y = Cx + Du 

► 


A 


X 0 

FIGURE 10.7 Block diagram of 
a state-space system. 


Taking the unilateral Laplace transform on both sides of Equation 10.31, we 
obtain 


s%(s) — x 0 = AT(s) + B7Z{s) 

Ws) = CZ(s) + Dte(s). (10.54) 

Solving for the Laplace transform of the state, we get 

%(s) = ( sI N - Af' B7t{s) + (sI N - Af 1 x 0 , (10.55) 

and the Laplace transform of the output is found: 

1f(s) = [C(sI N - Af'B + D]K(s) + C(sI N - Af' x 0 . (10.56) 

The first term on the right-hand side is the Laplace transform of the zero-state 
response of the system to the input u(t), whereas the second term is the Laplace 
transform of the zero-input response. The time-domain version of Equation 10.56 
is thus 


y(t) = y zs (t) + y zi (t) 


= J Ce AT Bu(t — z)dz + Du(t) + Ce A, x 0 q(t). 

o 


(10.57) 
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The transfer function of the system is given by 

'%(s) = ^- = C(sI N -Ay'B + D. (10.58) 

7i{s) 


Remark: Earlier, we said that there exist infinitely many state-space realizations 

of a single transfer function. To convince ourselves of this fact, let us simply 
consider the (infinitely many) realizations expressed by ( P~ l AP,P~ l B,CP,D ), 
VP e M' VxiV , det(P) A 0 whose transfer functions are all equal to the one given in 
Equation 10.58: 

CP(sI N - P-'APT 1 P~'B + D = CP(sP~ l P - p-'Apy l P~'B + D 

= CP[p-\sI N - A)P ]"' P-'B + D 
= CPP~' ( sI N - A) -1 PP 'B + D 
= C(sI N -Ay'B + D. 

Note that in Equation 10.58, we can write the ratio of the two Laplace trans- 
forms only because this is a single-input, single-output system. For multi- 
input, multi-output (MIMO, multivariable) systems, tyis) and U(s) are vectors and 
it would not make sense to have a ratio of two vectors. Nevertheless, the formula 
for the transfer function matrix of the system is still given by Equation 10.58, and 
one can write 


■»(s) = 7l{s) i — > Ps) = C(sI N - A)~' B + D. (10.59) 

Recall that the inverse of a square matrix is equal to its adjoint (transposed ma- 
trix of cofactors) divided by its determinant. Therefore, we have 

"»(s)= 1 — Cad](sI N -A)B + D. (10.60) 

det (sI N - A) 

The adjoint matrix only contains polynomials; thus, C adj(.s7 iV - A)B is a poly- 
nomial in the Laplace variable .v. It follows that the poles of H(s) can only come 
from the zeros of the polynomial det(\s/ v - A) , which are nothing but the eigen- 
values of matrix A. This is not to say that the set of poles is equal to the set of eigen- 
values of A in all cases (it can be a subset). However, for minimal state-space 
systems as defined below, these two sets are the same. 

The ROC of the transfer function will be specified after we give a result relat- 
ing the eigenvalues of A to the poles of the transfer function for minimal systems. 
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Bounded-Input, Bounded-Output Stability 

Minimal state-space realizations are realizations for which all N eigenvalues of ma- 
trix A appear as poles in the transfer function given by Equation 10.58 with their 
multiplicity. In other words, minimal state-space realizations are those realizations 
for which the order of the transfer function is the same as the dimension of the state 
vector. 

Fact: For a minimal state-space realization (A, B, C, D) of a continuous-time 
system with transfer function H(s), the set of poles of H(s) is equal to the set of 
eigenvalues of A. 

Since we limit our analysis to causal, minimal state-space realizations, this 
fact yields the following stability theorem for such continuous-time, LTI state- 
space systems. 

Stability Theorem: The continuous-time causal , minimal, LTI state-space sys- 

tem (A, B, C, D), where A e R NxN , B e R :Vxl , Cel lxl, ,/)eM, is bounded-input, 
bounded-output (BIBO) stable if and only if all eigenvalues of A have a negative 
real part. 

Mathematically, ( A, B, C, D) is BIBO stable if and only if Re{A, (A)} < 0, 
V/ = . 

The ROC of the transfer function in Equation 10.58 is the open right half-plane 
to the right of max Re {A,. (A)} . 

We found earlier that the impulse response of the state-space system is given 
by h(t) = Ce A 'Bq(t) + D8(t), where q(t) is the unit step function. Comparing 
this expression with Equation 10.58, the inverse Laplace transform of 
(si N - A) -1 , Re{s} > max Re {A,- (A)} is found to be equal to e Al q(t ) ; that is, 


e Al q(t) (si N - A) Reis} > max Re{A,.(A)} (10.61) 

Example 10.2: Find the transfer function of the causal minimal state-space sys- 

tem described by 


x(t) = 


-2.2 0.4 

- 0.6 - 0.8 


x(t) + 


2 

-1 


u(t) 


y(f) = [-l 3 ]jc(/) + 2k(/)- 


(10.62) 


First, we compute the eigenvalues of the A matrix by solving det(A/ - A) = 0 
to obtain A, = -1, A, = -2. Thus, the system is BIBO stable since the poles of the 
transfer function are negative, being equal to the eigenvalues. We use Equation 
10.58 to calculate H(s ): 
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H(s) = [- 1 3] 


5 + 2.2 - 0.4 

0.6 5 + 0.8 

1 


n-l r 2 n 


+ 2 


(5 + 2 . 2)(5 + 0 . 8 ) - (- 0 . 4 ) • 0.6 


1 


5 +35 + 2 


[-1 3] 


25 + 1.2 
- 5 - 3.4 


-1 

[ 1 3] II “ 1 + 2 

L J [_ -0.6 5 + 

- 55 - 11.4 + 2 ( 5 2 + 3 .V + 2 ) 


s + 0.8 

0.4 

' 2 " 

- 0.6 

5 + 2.2 

-1 


+ 2 = - 


2s~ + 5-7.4 s~ + 0.55 — 3.7 
- = 2 


5 +35 + 2 


5 ” + 35 + 2 


= 2 


5 ” + 35 + 2 
(5 + 2 . 19 )( 5 - 1 . 69 ) 

(5 + l )(5 + 2 ) ’ 


Re{5> > -1 (10.63) 


The eigenvalues of the A matrix are the same as the poles of the transfer func- 
tion, as expected since the realization is minimal. Now that the transfer function is 
known, the output response of the system for a specific input can be found by the 
usual method of partial fraction expansion of T(x) = H(s)U(s). 


STATE TRAJECTORIES AND THE PHASE PLANE 


The time evolution of an A-dimensional state vector x(t) can be depicted using N 
plots of the state variables x, (t) versus time. On the other hand, the state trajectory, 
that is, the locus of points traced by x(t), is a curved line in hyperspace R N . 

For a two-dimensional state vector, we can conveniently plot the state trajec- 
tory on a phase plane that is a plot of x 2 (t) versus x x (t) (or vice versa). For exam- 
ple, the state trajectory in the phase plane of a second-order system responding to 
an initial vector as a damped sinusoid will look like a spiral encircling and going 
toward the origin. 

Example 10.3: Consider the causal second-order mass-spring-damper system of 

Figure 10.8 modeled as a state-space system. 

Assume that the mass-spring-damper system is initially at rest, which means 
that the spring generates a force equal to the force of gravity to support the mass. 
The balance of forces on the mass and Newton’s law gives us an equation for state 
variable x 2 (t): 


mx 2 ( t ) = u(t)~ F k (. t ) - F b (, t ) 

= u{t) — kx l {t) — bx 2 {t), (10.64) 

and the second equation simply relates velocity and position: 


x ] (t) = x 1 (t). 


(10.65) 




State Models of Continuous-Time LTI Systems 371 


u(t) (force input) 

^ 1 — | x t (t) : mass position wrt rcsl 

X (/ ) : mass velocity 


k < P| b 


force applied on mass by spring and gravity: 

F t (t) = kx,(l) 

force applied on mass by damper: 

F h (t) = bx 2 (l) 


FIGURE 10.8 Mass-spring-damper system. 


Let the state vector be x(t) := 


*r(0 

X 2 (t) 



0 

1 


" 0 " 

x(t) = 

-V 

L / m 

-W 

/ m j 

x(t) + 

L/«rJ 


. The state equation can be written as 

«(/). (10.66) 


Suppose the physical constants have numerical values m = 10 kg, k = 10 N/m, 
and b = 5 N/ 1 ^. We get 


x(t) = 


0 1 
-1 -0.5 


x(t ) + 


0 

0.1 


u(t). 


(10.67) 


The zero-input state response to the initial condition of the mass displaced by 
5 cm so that x(0) = °'°~ gives rise to the spiral-shaped state trajectory shown on 
the phase plane in Figure 10.9. 

This phase plane plot was generated by the following MATLAB script, which 
can be found on the CD-ROM in D:\ChapterlO\phaseplane.m. 


%% Phase plane state trajectory of mass-spring-damper system 
% Define state-space system 
A= [ 0 1 ; -1 -0.5] ; 

B=[0; 0.1]; 

C=eye (2) ; 

D=zeros(2, 1 ) ; 
x0=[0.05; 0]; 

% time vector 
T=0: .1 : 1 00; 

% input signal (zero) 

U=zeros(length(T) , 1 ) ; 
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%simulate 
SYS=ss (A, B , C , D) ; 

[YS,TS,XS] = LSIM (SYS , U , T , xO) ; 
plot(100*XS( : ,1 ) ,100*XS( : ,2) ) 



A', (an) 

FIGURE 10.9 Phase plane trajectory of a second-order 
state-space system. 


BLOCK DIAGRAM REPRESENTATION OF CONTINUOUS-TIME 
STATE-SPACE SYSTEMS 


The block diagram in Figure 10.10 is often used to describe a continuous-time 
state-space system. Note that some of the signals represented by arrows are vector- 
valued and the gains are “matrix gains.” 



FIGURE 10.10 Block diagram of a state-space system. 
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One can see that this is a generalization of a scalar first-order system, with N 
integrators in parallel instead of just one. Remember that matrices do not commute 
in general, even if they are conformable. Thus, in deriving the equations for 
the above block diagram, one has to be careful not to write something like 
C(sI N - Ay 1 B = B(sI N - Ay'C = CB(sI N - A)' 1 . In other words, the order in 
which subsystems appear in block diagrams of multivariable LTI systems cannot 
be changed. 


SUMMARY 


In this chapter, we introduced LTI state-space systems. 

■ A state model of a physical system can often be obtained from first principles 
as a collection of first-order differential equations together with an output 
equation. 

■ Two state-space realizations of any proper rational transfer function can be eas- 
ily obtained: the controllable canonical realization and the observable canoni- 
cal realization. However, there exist infinitely many realizations of any given 
proper rational transfer function. 

■ We derived the formulas for the zero-input and zero-state responses, the im- 
pulse response, and the transfer function of a general LTI state-space system. 

■ A causal minimal state-space system was shown to be BIBO stable if and only 
if all of the eigenvalues of its A matrix lie in the open left half-plane. 

■ We briefly discussed state trajectories, and the phase plane was illustrated with 
an example. 


TO PROBE FURTHER 


State-space modeling of engineering systems is covered in Belanger, 1995. For an 
advanced text on state-space systems, see Chen, 1999. 


EXERCISES 


Exercises with Solutions 

Exercise 10.1 

Consider the causal LTI state-space system: 
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x = Ax + Bit 
y = Cx, 


where A = 



C = [l 1] , 


(a) Is the system stable? Justify your answer. 


Answer: 

We compute the eigenvalues of the A matrix: 


det 


A + 1 
1 


-1 
A + 1 


— (A + 1)(A + 1) + 1 — A 2 + 2A + 2 


=>A 1 = -1 + j, A 2 =-l- j, 


The eigenvalues of the A matrix A in =-l + j have a negative real part; there- 
fore the system is stable. 

(b) Compute the transfer function H(s) of the system. Specify its ROC. 


Answer: 


H(s) = C(sI 2 -Ay'B 


= [1 1 ] 


5 + 1 

-1 ' 

-1 

V 

1 

5 + 1 


0 


1 


s + 2s + 2 
i 

s 2 +2.V + 2 


[1 1 ] 
[1 1 ] 


5 + 1 1 

-1 5 + 1 

5 + 1 


1 

0 


-1 


5 +25 + 2 


, Re{5} > -1 


The poles of the transfer function are -C,(O n ± jco n ^/l-^ 2 =-^\j2± j~Jl 
= -1 ± j 1 , equal to the eigenvalues, as expected. 

(c) Compute the impulse response h(t) of the system using the matrix 
exponential. 


Answer: 

The eigenvectors of the A matrix are computed as follows: 
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Exercise 10.2 

Find the controllable and observable canonical state-space realizations for the fol- 
lowing LTI system: 


H(s)= S 3 + ^^~ 2 , Re{.v} > 0. 
S + 5s 
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Answer: 

The system’s controllable canonical state-space realization is shown in Figure 10. 1 1 . 



FIGURE 10.11 Controllable canonical realization of the system of Exercise 10 . 2 . 


Referring to Figure 10.1 1, we can write down the state-space equations of the 
controllable canonical realization of the system: 

x, (t) 0 1 0 jc, (?) 0 

x 2 (t) = 0 0 1 x 2 {t ) + 0 u(t), 

x 3 (f) 0-3 0 x 3 (f) 1 

x, 0) 

y(f) = [ 2 -2 0] x 2 (t) +u(t). 

_x 3 (t)_ 

The observable canonical realization is the block diagram of Figure 10.12. 
From Figure 10.12, the state-space equations of the observable canonical real- 
ization of the system can be written as 

Xj(f) 0 0 0 Xj(t) 2 

x 2 (f) =10-3 x 2 (f) + -2 u{t), 
x 3 (f) 010 x 3 (t) 0 
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U(s) 



FIGURE 10.12 Observable canonical realization of the system of Exercise 10.2. 


x x {t) 

y(f) = [0 0 l] x 2 (t) +u(t). 

_x 3 (t)_ 

Exercises 

Exercise 10.3 

Compute e A + 1 for A = ^ '' . 

Answer: 

(C; 

ON THE CD 

Exercise 10.4 

Consider the causal LTI state-space system 
x = Ax + Bu, where A= ^ , B = l Q , C = [l l], 

(a) Is the system stable? Justify. 

(b) Compute the transfer function H(s) of the system. Specify its ROC. 

(c) Compute the impulse response h(t) of the system using the matrix exponential. 
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Exercise 10.5 

, C = [0 l]. What type of sys- 
tem is this? 

(a) Is the system stable? Justify. 


Repeat Exercise 10.4 with A = 


0 o 

1 0 


B = 


0 0 
I 0 


(b) Compute the transfer function H(s) of the system. Specify its ROC. 

(c) Compute the impulse response h(t) of the system using the matrix expo- 
nential. 


Answer: 



ON THE CD 


Exercise 10.6 

Find the controllable and observable canonical state-space realizations for each of 
the following LTI systems. 

(a) h(t) = e~ 2 ' q(t) + te 2 ' cj{t) 


(b) 


s 3 + s 2 + 2s + 1 
s 3 + 5 s 2 + 2s 


, Re{.v} > 0 


Exercise 10.7 


Find the controllable and observable canonical state-space realizations for each of 
the following FTI systems. 

(a) h{t) = e~ 3l q(t) + e~'q(t ) + 8(t ) 


(b) 


F + 5 

s + 2s + 2s + 1 


Re{s} > -0.5 


(c) 


ij 


"-1 0 " 

X l 


"3" 


X l 

_*2_ 

— , 

0 -2 

x 2 

+ 

1 

u, y = [ 2 l] 

X 2 


causal 


Answer: 



ON THE CD 


Exercise 10.8 

(a) Compute e A for a 


o r 

3 2 
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(b) Compute the zero-input state and output responses at time t l —2 for the 
causal LTI state-space system 


C = [ 1 0], 

with initial state *( 0 ) = 1 . 

Exercise 10.9 

Consider the causal LTI state-space system 


= Ax + Bu,y= Cx where A-- 


o 1 

3 2 


, B- 


x = Ax+ Bit, y=Cx where a 


-ll l " 
3 -9 ’ 



C = [l 1]. 


(a) Is the system minimal? Is it stable? Justify. 

(b) Compute the transfer function H(s) of the system. Specify its ROC. 

(c) Compute the state transition matrix defined as 0(1, f 0 ) := e MM " ] . This ma- 
trix has the property of taking the zero-input state response from the initial 
state x(f 0 ) to the state x(t) as follows: x(t) = O(f,f 0 )x(f 0 ) . 

(d) Compute the impulse response h(t) of the system using the matrix 
exponential. 


Answer: 



ON THE CD 


Exercise 10.10 

Consider the LTI causal state-space system 

x = Ax + Bit 
y = Cx + Du, 

where x(f) e M' v , y(t) e M, u(t ) e M. Show that any state transformation z = Qx, 
where Q e M WxA/ is invertible, of the above state-space system keeps its transfer 
function invariant. This means that there are infinitely many state-space represen- 
tations of any given proper rational transfer function. 
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Application of Transform 
Techniques to LTI Feedback 
Control Systems 


In This Chapter 

■ Introduction to LTI Feedback Control Systems 

■ Closed-Loop Stability and the Root Locus 

■ The Nyquist Stability Criterion 

■ Stability Robustness: Gain and Phase Margins 

■ Summary 

■ To Probe Further 

■ Exercises 


(( Lecture 36: Introduction to LTI Feedback Control Systems)) 

T he use of feedback dates back more than two thousand years to the Greeks 
and the Arabs, who invented the water clock based on a water level float 
regulator. Closer to us, and marking the beginning of the industrial revolu- 
tion in 1769, was the invention by James Watt of the Watt governor, shown in Fig- 
ure ILL The Watt governor was used to regulate automatically the speed of steam 
engines by feedback. This device measures the angular velocity of the engine shaft 
with the help of the centrifugal force acting on two spinning masses hinged at the 
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top of the engine shaft. The centrifugal force is counteracted by the gravitational 
force. When in balance at a constant engine speed, the vertical positions of the 
masses are given by a function of the shaft angular velocity, and their vertical dis- 
placement is linked to a valve controlling the flow of steam to the engine. Thus, the 
Watt governor is a mechanical implementation of proportional control of the en- 
gine shaft velocity. 



FIGURE 11.1 Schematic of the Watt governor. 


It has only been about 70 years since engineers and mathematicians developed 
the mathematical tools to analyze and design feedback control systems. However, 
feedback control has proven to be an enabling technology in many industries and 
it has enjoyed a lot of interest in research and development circles. This chapter 
only gives a brief introduction to linear time-invariant (LTI) feedback control sys- 
tems and studies them with the use of the Laplace transform. The most important 
property of a feedback control system is its stability, and therefore we present var- 
ious means of ensuring that the closed-loop system will be stable. Tracking systems 
and regulators are defined and their performance is studied with the introduction of 
the sensitivity function and the complementary sensitivity function. 


INTRODUCTION TO LTI FEEDBACK CONTROL SYSTEMS 


A feedback control system is a system whose output is controlled using its mea- 
surement as a feedback signal. This feedback signal is compared with the reference 
signal to generate an error signal that is filtered by a controller to produce the 
system’s control input. We will concentrate on single-input, single-output (SISO) 
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continuous-time LTI feedback systems. Thus, the Laplace transform will be our 
main tool for analysis and design. The block diagram in Figure 1 1.2 depicts a gen- 
eral feedback control system. Note that all LTI systems represented by transfer 
functions in this chapter are assumed to be causal, and consequently we omit their 
regions of convergence (ROCs), which are always understood to be open right 
half-planes (RHPs). 
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► 
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l 

! y„,( T ) 

y,M) 




1 

1 



sensor 






FIGURE 1 1.2 LTI feedback control system. 


The controlled system is called the plant, and its LTI model is the transfer 
function P(s). The disturbed output signal of the plant is y(t) and its noisy mea- 
surement is y m (t), corrupted by the measurement noise 77 (f). The error between the 
desired output y d {t) (or reference) and y m (t) is the measured error, denoted as ejt). 
The actual error between the plant output and the reference is e{t ) := y d (t) — y(t). 
The output disturbance is the signal d„(t). The feedback measurement sensor dy- 
namics are modeled by G,„(s). The actuator (e.g., a valve) modeled by GJs) is the 
device that translates a control signal from the controller K(s) into an action on the 
plant input. The input disturbance signal c/ ( (f) (e.g., a friction force) disturbs the 
control signal from the actuator to the plant input. 

In many cases, we will assume that the actuator and sensor are perfect (mean- 
ing G a (s) = G m (s) = 1) and that measurement noise can be neglected so that 
77(f) = 0. This will simplify the analysis. 

Why do we need feedback anyway? Fundamentally, for three reasons: 

■ To counteract disturbance signals affecting the output 

■ To improve system performance in the presence of model uncertainty 

■ To stabilize an unstable plant 
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Example 11.1: A classical technique to control the position of an inertial load 

driven by a permanent-magnet DC motor is to vary the armature current based on 
a potentiometer measurement of the load angle as shown in Figure 11.3. 



FIGURE 11.3 Schematic of an electromechanical feedback 
control system. 


Let us identify the components of this control system. The plant is the load. 
The actuator is the DC motor, the sensor is the potentiometer, and the controller 
K(s) could be an op-amp circuit driving a voltage-to-current power amplifier. 

The open-loop dynamics of this system are now described. The torque z(t) in 
newton-meters applied to the load by the motor is proportional to the armature cur- 
rent in amperes: T (t) = Ai a (t), so that 


n , TO) . 
G a (s) = TTT = A - 


(H.l) 


The plant (or load) is assumed to be an inertia with viscous friction. The equa- 
tion of motion for the plant is 


T d 2 9(t) dQ(t) ^ 

J z— + b = T (t) 

dt 2 dt 

which yields the unstable plant transfer function: 

G(s) 1 


( 11 . 2 ) 


P(s) = 


T (s) s(Js + b ) 


(11.3) 
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The potentiometer can be modeled as a pure gain mapping the load angle in the 
range of [0 ,tt] radians to a voltage in the range of [0V,+10V]: v(t) = B9(t) = 


Q{t ) ; thus. 


G m (s) = 


OJs) 


0 m (s) v(s) =B - lB = h 


6(s ) v(s ) 6(s) 


(11.4) 


Assume that the measurement noise is negligible and that there is only an input 
torque disturbance T ,(t) representing unmodeled friction. A block diagram for this 
example is given in Figure 1 1.4. 


r ,(0 



sensor 

FIGURE 11.4 Block diagram of an electromechanical feedback control system. 


Other examples of feedback control systems abound: 

■ Car cruise control system 

■ Flight control system (autopilot, fly-by-wire control) 

■ Satellite attitude control system 

■ Phase-lock loop ( circuit used to tune in to FM radio stations in radio receivers) 

■ Robot 

■ Fluman behavior (this one is hard to model) 

■ Nuclear reactor 

Tracking Systems 

Two types of control systems can be distinguished: tracking systems and regula- 
tors. As the name implies, a tracking system controls the plant output, so it tracks 
the reference signal. From the simplified block diagram in Figure 1 1.5 (no noise or 
disturbance), good tracking is obtained when the error signal e(t) ~ 0 for all de- 
sired outputs yjt). Then, y(t ) ~ y d (t ) . 
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yA*) 



K(s) 

u(t) 

P{s) 

y{» 

D ► 

i 

— — ► 









FIGURE 1 1.5 Unity feedback control system 
for tracking. 


This diagram represents a general unity feedback system. Such a system has no 
dynamics in the feedback path, just a simple unity gain. The mechanical load angle 
control system in Example 11.1 is a unity feedback tracking system. The closed- 
loop transfer function from the reference to the output, called the transmission, is 
given by 


yp) = K(s)P(s) 
y d (s) 1 + K(s)P(s) 


(11.5) 


The tracking objective of y(t) ~ y d (t) translates into the following require- 
ment on the transmission: 


T(j)«1. (11.6) 

We see that this objective will be attained for a “large” loop gain, that is, for 
|A'(s)P(s)| » 1, which, for a given plant, suggests that the magnitude of the con- 
troller be made large. However, we will see later that a high-gain controller often 
leads to instability of the closed-loop transfer function. 

Regulators 

A regulator is a control system whose main objective is to reject the effect of dis- 
turbances and maintain the output of the plant to a desired constant value (often 
taken to be 0 without loss of generality). An example is a liquid tank level regula- 
tor. The block diagram shown in Figure 1 1.6 is for a regulator that must reject the 
effect of an output disturbance. 

The transfer function from the output disturbance to the output, called the sen- 
sitivity, is obtained from the following loop equation: 


y(s) = - K(s)P(s)y(s ) + d o (s), 


(11.7) 
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FIGURE 1 1.6 Unity feedback control system for 
regulation. 


which yields 


S(s):= 


yjs) = l 
d„(s) 1 + K( S )P( S y 


( 11 . 8 ) 


The objective that y(t) ~ 0 for expected output disturbance signals translates 
into the requirement that S(s)~ 0. Again, a high loop gain (s)P(s)| :» 1 would 
appear to be the solution to minimize the sensitivity, but the closed-loop stability 
constraint often makes this difficult. 



((Lecture 37: Sensitivity Function and Transmission)) 


Sensitivity Function 

We introduced the sensitivity function as the transfer function from the output dis- 
turbance to the output of the plant, 


S(s):= 


y(s) _ l 
djs) 1 + K( S )P( S y 


(11.9) 


for the standard block diagram in Figure 11.6. The term sensitivity can be attributed 
in part to the fact that the transfer function S(s) represents the level of sensitivity of 
the output to an output disturbance: 

y(s) = S(s)d 0 (s). (11.10) 


If the disturbance signal has a Fourier transform, then (assuming S(s) is stable 
and hence has a frequency response SQ'co)), the Fourier transform of the output is 
given by 


y(jco) = S(jco)d 0 (jco). 


(11.11) 
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Therefore, the frequency response of the sensitivity S( j to) amplifies or attenu- 
ates the output disturbance at different frequencies. Note that since the error is sim- 
ply the negative of the output, we also have 

e(s) = -S(s)d 0 (s). (11.12) 


Example 11.2: Suppose d 0 (t ) = e ' q(t ) for the control system depicted in Figure 

11.7. 


d„{‘) 


0 + 

e(t) 

-s fc. 

10 

11 (t) 

1 

+ 

“I 

J * 

i 

5 + 1 


5 + 3 

+ 


K(s) 


y(t ) 


P(S) 


FIGURE 11.7 Regulator with exponential 
output disturbance. 


The Fourier transform of the disturbance signal d 0 (t) is given by 


d 0 (ja>) = 


1 + jco 


The sensitivity function is calculated as follows: 


(11.13) 


S(s) = 


1 


1 + 


10 

(s + l)(.v + 3) 


(s + !)(.? + 3) _ (g+lXg+3) 

r + 4.V + 13 _ (s + 2-j3)(s + 2 + j3) 


(11.14) 


This sensitivity function is stable because its complex conjugate poles lie in the 
open left half-plane (LHP). Its frequency response is given by 


S(jco) = 


(jco + 1 )(jco + 3) 
13 -co 2 + j4co 


(11.15) 


The magnitudes of S(jco),d 0 (jco),y(jco) are plotted using a linear scale in 
Figure 1 1.8. 
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FIGURE 1 1.8 Magnitude of the output caused by 
the disturbance in closed loop. 

It can be seen that the controller reduces the effect of the output disturbance by 
roughly a factor of five in the frequency domain, as opposed to the open-loop case. 
That is, the sensitivity was made small in the bandwidth of the disturbance. In the 
time domain, the closed-loop plant response 

y(0 = £ l {s(s)rf 0 (s)} = £“ 2 '^cos3/ : + -^sin3f q(t ) (11.16) 

to the disturbance is smaller in magnitude than the open-loop response 
y 0L (t) = d 0 (t ) = e~‘q(t ) , as shown in Figure 1 1.9. 



FIGURE 11.9 Open-loop and closed-loop 
response to disturbance in the time domain. 
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However, if the disturbance signal had energy around (0 = 4 rad/s , it would be 
amplified around this frequency. 

The main reason S(s) is called the sensitivity function is because it is equal to 
the sensitivity of the closed-loop transmission T(s) to an infinitesimally small 
perturbation of the loop gain defined as L(s ) := K(s)P(s ) . That is, for an infinites- 
imally small relative change -jjy in the loop gain, the corresponding relative 
change y-y in the transmission is given by 


dT(s) 
T{s) 
dL(s ) 
Us) 


U£)<jrf£)_[ 1+ . d lm 

T(s)dL(s ) L J r/L(s)l + L(s) 


[1 + L(s)] 


(1 + L(s))-L(s) 

lf/T.v )| 2 


1 

1 + L(s) 


= S(s). 


(11.17) 


Transmission 

The transmission is the closed-loop transfer function T(s) introduced earlier. The 
transmission is also referred to as the complementary sensitivity function, as it 
complements the sensitivity function in the following sense: 

S(s) + T(s) = l. (11.18) 


We have seen that T(s) is the closed-loop transfer function, 


y(s) _ K(s)P(s) 
y d (s ) 1 + K(s)P(s)’ 


(11.19) 


from the reference signal (desired output) to the plant output in tracking control 
problems for the standard unity feedback control system shown in Figure 11.10. 


yjt) + 

e(t) 

K(s) 

ll{t) 


y(t) 

A 

} ► 

► 



- 








FIGURE 11.10 Feedback control system for 
input tracking. 
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Usually, reference signals have the bulk of their energy at low frequencies 
(e.g., piecewise continuous signals) but not always (e.g., fast robot joint trajecto- 
ries). The main objective for tracking is to make T (jco) ~ 1 over the frequency 
band where the reference has most of its energy. 

Example 11.3: Consider the previous regulator example now set up as the track- 

ing system in Figure 11.11. 


.u(0 


+ e(t) 

10 

ll(t) 

1 

>■(/) 


j H 

k 

s + l 

► 

5 + 3 




K(s) 




FIGURE 1 1.1 1 Feedback control system for 
input tracking. 


The transmission can be calculated using Equation 11.18: 


T(s) = 1-5(5) = 1 


r + 4.V + 3 
s 2 +4.V + 13 


10 

5 2 +4.v + 13‘ 


( 11 . 20 ) 


Although its DC gain of T (0) = 10/13 = 0.77 is not close to 1, the magnitude 
of its frequency response is reasonably flat and the phase reasonably close to 0 up 
to CO = 1 rad/s, as can be seen in Figure 11.12. 

Suppose that the reference signal is a causal rectangular pulse of 10-second 
duration: 

y d (t) = q(t)-q(t- 10). (11.21) 


Its Laplace transform is given by 


>’ rf O) = 



so that the Laplace transform of the plant output is 


y(s) = T(s)y d (s) = 


10(1 -e~ 10 *) 
s(s 2 + 4.v + 13) ' 


( 11 . 22 ) 


(11.23) 
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FIGURE 1 1.12 Frequency response of transmission. 


The corresponding time-domain output signal is plotted in Figure 11.13, to- 
gether with the reference signal. 

1.2 
1 

0.8 
0.6 
0.4 
0.2 
0 

-0.2 

0 2 4 6 8 10 12 14 16 18 20 

t 

FIGURE 11.13 Closed-loop response of 
tracking system to a 1 0-second pulse. 



Apart from a settling value lower than 1 due to the DC gain, the response is not 
too bad. This must mean that in the frequency domain, the Fourier transform of the 
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reference must have most of its energy in the passband of the transmission. It is in- 
deed the case, as seen in the plot of \y d (jco)\ in Figure 11.14: 

. I0e~ j5<0 . 5 CO. ... 

y d (jco) = smc( — ). (11.24) 

n n 


| VrfO'fi 
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!\, 
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10" 1 




FIGURE 11.14 Magnitude of the input pulse's 
spectrum. 


A Naive Approach to Controller Design 

Given a plant model P(s) and a desired stable closed-loop sensitivity or transmis- 
sion, it is often possible to back solve for the controller K(s) using Equation 1 1.9 
or 11.19. 

Example 11.4: A plant is modeled by the transfer function P(s) = — . Let us 

find the controller that will yield the desired complementary sensitivity function 
T(s ) = ^ m |(| . From Equation 1 1.19, we have 


K(s) = 


T\s) 

P(s)[l-T(s)] 


10 


£+10 


2 

s + 1 



10 

T+io 


5A + 1) 
5(5 + 10)' 


(11.25) 
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This looks easy, and it is. However, this approach has many shortcomings, 
including 


■ For unstable plant models (i.e., P(s) with at least one pole in the open RHP), 
the resulting controller's) will often have a zero canceling the unstable plant 
pole in the loop gain, which is unacceptable in practice. 

■ For a non-minimum phase plant model P(s), that is, with at least one zero in the 
open RHP, the controller K(s) will often have an unstable pole canceling the 
RHP plant zero in the loop gain, which may be undesirable in practice. 

■ This method cannot meet other specifications or requirements on closed-loop 
time-domain signals, low controller order, etc. 

■ The controller may not always be proper; that is, its transfer function may 
sometimes have a numerator of higher order than the denominator. Such a 
controller is not realizable by a state-space system or by using integrators. One 
would then need to use differentiators that should be avoided because they tend 
to amplify the noise. 



((Lecture 38: Closed-Loop Stability Analysis)) 


CLOSED-LOOP STABILITY AND THE ROOT LOCUS 


Closing the loop on a stable plant with a stable controller will sometimes result in 
an unstable closed-loop system; that is, the sensitivity and the transmission will be 
unstable. Hence, a number of stability tests have been developed over the last cen- 
tury in order to avoid the tedious trial and error approach to obtain closed-loop sta- 
bility in the design of a controller. The idea is to test for stability, given only the 
open-loop transfer functions of the plant and the controller. 

Closed-Loop Stability 

The most fundamental property of a feedback control system is its stability. Obvi- 
ously, an unstable feedback system is useless (unless the goal was to build an os- 
cillator using positive feedback in the first place). In this section, we give four 
equivalent theorems to check the stability of a unity feedback control system. 

We shall use the following definition of bounded-input bounded-output 
(BIBO) stability (or stability in short) for a unity feedback system. This is a re- 
quirement that any bounded-input signal injected at any point in the control system 
results in bounded-output signals measured at any point in the system. 

The unity feedback system in Figure 11.15 is said to be stable if, for all 
bounded inputs y d (t), dtyt ) , the corresponding outputs y(t), u c (t ) are also bounded. 
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FIGURE 11.15 Setup to test the BIBO stability of a closed- 
loop system. 


The idea behind this definition is that it is not enough to look at a single input- 
output pair for BIBO stability. Note that some of these inputs and outputs may not 
appear in the original problem formulation, but they can be defined as fictitious in- 
puts or outputs for stability assessment. 

Recall that a transfer function G(s) is BIBO stable if and only if 

1 . All of its poles are in the open LHP and 

2. It is proper, that is, lim G(s) < °° or, equivalently, the order of the numer- 

S — >°o 

ator is less than or equal to the order of the denominator for G(s ) rational. 

The second condition is required because otherwise a bounded input \u(t)\ < M 
with arbitrarily fast variations would produce an unbounded output for an improper 
transfer function. Consider for example a pure differentiator G(s) = s with the 
input «(r) = sin(f 2 ). Its output is y(t) = 2/ cos(r) , which is unbounded as t—>+°°. 

Closed-Loop Stability Theorem I 

The closed-loop system in Figure 11. 15 is stable if and only if the transfer functions 
T(s), P ' (s)T ( s ), and P(s)S(s) are all stable (unstable pole-zero cancellations are 
allowed in these products). 

Proof: It is easy to find the relationship between the inputs and the outputs (do it 

as an exercise): 


y{s) 


T(s) 

P(s)S(s) 

yff) 


_ufs)_ 


P-\s)T(s ) 

-ns) _ 

_dfs)_ 

(11.26) 


This matrix of transfer function (called a transfer matrix) is stable if and only if 
each individual transfer function entry of the matrix is stable. The theorem follows. 
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Example 11.5: Let us assess the stability of the tracking control system shown in 

Figure 11.16. 


MO 



s- 1 

fi(s) 

1 

y(s) 

( * 

s + 1 

► 

s 2 -1 




A'U) 


P{s) 


FIGURE 11.16 Closed-loop system whose stability is to 
be determined. 


Note that the open-loop plant P(s) is unstable. We calculate the three transfer 
functions: 


, K(s)P(s) 

T (s) = 

1 + K(s)P(s) 


P-\s)T(s) = 


P(s)S(s) = 


K(s ) 

1 + K(s)P(s) 

m 

1 + K(s)P(s) 


— ( stable ) 

s~ + 2s + 2 


— r ( stable ) 

s + 2s + 2 

1 


(s 2 - l)(r + 2s + 2) 


(i unstable ) 


(11.27) 


and conclude that this closed-loop system is unstable. The problem here is that the 
controller attempts to cancel out the plant’s unstable pole. 

We know that stability is directly related to the location of the poles in the s- 
plane. Since control systems are causal, the ROC of S(s) and T(s) is an open RHP 
to the right of the rightmost pole. For BIBO stability, the ROC must include the 
yen-axis, (including °°), which means that all the closed-loop poles must be in the 
open LHP and that S(s) and T(s) must be proper. Note that the poles of S(s) and T(s) 
are the same, and if either of these two transfer functions is proper, then the other 
one must also be proper. This is easy to see from the identity: 

T(s) = l-S(s). (11.28) 

If S(p i ) = then T (p t ) = “ and vice versa. 

Another equivalent closed-loop stability theorem can now be stated (without 
proof) for a unity feedback control system if we explicitly rule out any pole-zero 
cancellation occurring in the closed RHP when forming the loop gain K(s)P(s). 
One only needs to check the stability of either S(s) or T(s). 
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Closed-Loop Stability Theorem II 

The unity feedback control system in Figure 11.15 is stable if and only if 

1. Either Sts) or T(s) is stable, and 

2. No pole-zero cancellation occurs in the closed RHP when fanning the 
loop gain K(s)P(s). 


Now suppose that the plant and controller transfer functions are written as 


P(s) = 


n P (s) 

d P (s) 


K(s) = 


n K (s) 
d % (s) 


(11.29) 


where the plant numerator and denominator n,,(s), d p (s) are coprime polynomials, 
that is, they have no common factors, and likewise for the controller numerator and 
denominator. Define the characteristic polynomial 


p(s) := n P (s)n K (s) + d P (s)d K (s) (11.30) 

of the closed-loop system. The closed-loop poles of the system are defined to be 
the zeros of the characteristic polynomial p(s). Our third equivalent stability result 
follows. 


Closed-Loop Stability Theorem III 

The unity feedback control system is stable if and only if all of the closed-loop poles 
of the system lie in the open LHP and the order of p(s) is equal to the order of 
d p (s)d K (s). 

Proof (sufficiency only; the proof of necessity is more involved): we use the result 
of stability Theorem I to write 


y(s) 

1 

P(s)K(s) 

P(s) 

X/O) 

_u c (s)_ 

” 1 + P(s)K(s) 

K(s) 

~P(s)K(s) 

_d,(s)_ 



n P (s)n K (s) 

n P (s) 


d p (s)d K (s) 

d P (s)d K (s) 

d P (s) 


d p ( s)d K (s) + n P ( s)n K ( s ) 

n K {s) 

n p (s)n K (s) 

_d,(s) 


d k 

d p (s)d K (s) 


1 

n P (s)n K (s) 

d K (s)n P (s) 1 


d p ( s)d K (s ) + n p ( s)n K ( s ) 

_d P (s)n K (s) 

-n p (s)«*(s)J 

dfs)_ 


(11.31) 
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All transfer functions in this matrix are proper and have the characteristic poly- 
nomial p(s) as their denominator. Therefore, if all closed-loop poles (i.e., zeros of 
p(s)) are in the open LHP, then the transfer matrix is stable, and by virtue of The- 
orem I, we conclude that the closed-loop system is stable. 

Example 11.6: For Example 11.5, we have 

n P (s ) = 1, d p (s ) = (.v + l)(s — 1), n K (s) = (s- 1), d K (s ) = (5 + 1) (11.32) 


and 


p(s) = (s — l) + (.v + l) 2 (s-l), (11.33) 

which clearly has a zero at s = 1. Therefore the control system is unstable. 

Finally, we have a fourth equivalent theorem on closed-loop stability, which is 
really just a restatement of Theorem II (taking S(s)). 

Closed-Loop Stability Theorem IV 

The unity feedback control system is stable if and only if 

1. The transfer function 1 + K(s)P(s) has no closed RHP zeros (including at °°), 
and 

2. No pole-zero cancellation occurs in the closed RHP when forming the 
loop gain K(s)P(s). 

Routh's Criterion 

The stability of a causal LTI system whose transfer function is rational and proper is 
determined by its poles. An open-loop transfer function is stable if and only if all of 
its poles lie in the open LHP. A closed-loop system is stable if and only if all 
of the closed-loop poles lie in the open LHP (closed-loop theorem III). In both cases, 
we need to solve for the N roots of the characteristic equation 

a N s N +ci N _ l s N ~ 1 -\ 1 - « r v + a 0 = 0 to find the poles and determine whether the 

system is stable or not. There are various ways to do this numerically using a com- 
puter, for example, by computing the eigenvalues of the A matrix of a state-space re- 
alization of the system. However, in 1877, E. J. Routh devised an extremely simple 
and clever technique to determine the stability of a system. Routh’s criterion is based 
on an array formed with the coefficients of the denominator of an open- loop transfer 
function or the closed-loop characteristic polynomial of a feedback system. Assume 
that a N > 0 , and recall that a necessary condition for the system to be stable is that 
all coefficients of its characteristic polynomial be of the same sign. Thus, if any of the 
coefficients of the polynomial are negative, the system is unstable. With this neces- 
sary condition fulfilled, we want to determine whether the system is stable or not. 
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The Routh array is formed as follows. The rows are labeled with descending 
powers of the Laplace variable 5. The first two rows of the array are composed of 
the coefficients of the characteristic polynomial. They can be written down by in- 
spection. The third row of the Routh array is calculated from the first and second 
rows. The looping arrow on the array attempts to show how the coefficients on a 
diagonal are multiplied before they are subtracted. Notice that this loop always 
starts and ends on the first column. 


s N 

CL„ 

n 

a N- 4 


N " 

U N - 2 


a N-\ 

a N - 3 

a N - 5 

N-2 

a N-\ a N-2 ~ a N-3 a N 

a N-\ a N-A ~ a N-5 a N 

a N-i a N-6 ~ a N-i a N 


a N-l 

a N - 1 

a N - 1 


The fourth row is computed in the same manner from the two rows immedi- 
ately above it, and so on until the last row labeled s° is reached. Once this Routh 
array has been computed, we have the following theorem: 

Theorem (Routh): The system is stable if and only if all the entries in the first 

column of the Routh array are positive. If there are sign changes in this column, 
then there are as many unstable poles are there are sign changes. 

Example 11.7: Let us determine whether the following causal system is stable: 


J-7Yo\ — 

l 

n i o ) f. . 


/ + 55 5 

+ 9s 4 + 10s 3 + 1 Is 2 + 10.v + 3 

The Routh array is computed. 


6 

s 

1 9 11 3 

5 

s 

5 10 10 

4 

s 

7 9 3 

,.3 

25 55 


7 7 

2 

3 

S 

5 

1 

305 




32 

5° 

3 
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We conclude that this system is unstable. Furthermore, since there are two sign 
changes in the first column, that is, from positive to negative to positive, we know 
that the system has two unstable poles. 


Example 1 1.8: Consider a unity feedback control system with plant P(s) = ;(j2+ ^ +1) 

and a pure gain controller K(s) = k. Let us find for what values of k the system is 
stable. The closed-loop characteristic polynomial is p(s) = s' + s 2 + s + k. We 
compute the Routh array. 


s 3 1 1 

s 2 1 k 

s 1 1 — k 


s 


o 


k 


Since it is assumed that controller gain k is positive, the system is stable for 
0 < k < 1 . For k > 1 , there are two sign changes in the first column; therefore the 
closed-loop system has two unstable poles. The limit case where k = 1 results in 
two poles sitting directly on the /Yn-axis. This special case of purely imaginary 
poles is treated in a slightly different way in the Routh array. When the Routh array 
is computed, this case leads to a row of zeros, for example, the row labeled s'" -1 . 
Then we write down the m'^-ordcr polynomial whose coefficients are the entries in 
row s m , the row above the row of zeros. This polynomial is differentiated and the 
coefficients of the resulting polynomial are used to replace the zeros in row s'" -1 . 



((Lecture 39: Stability Analysis Using the Root Locus)) 


The Root Locus 

The root locus is the locus in the s-plane described by the closed-loop poles 
(i.e., the zeros of the characteristic polynomial p(s)) as a real parameter k varies 
from 0 to +oo in the loop gain. It is a method for studying the effect of a parameter 
on the locations of the closed-loop poles, in particular to find out for what values 
of the parameter they become unstable. 

The parameter is usually the controller gain, but it could be a parameter of the 
plant transfer function. The usual setup is shown in Figure 11.17. 
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FIGURE 11.17 Closed-loop system with variable 
gain on the controller for the root locus. 


Factor .P(s) and K(s) as ratios of coprime polynomials: 


P(s) = 


n P (s) 
d p (s )’ 


K(s) = 


n K (s) 
d k 


(11.34) 


Then, p(s) = kn P (s)n K (s) + d p (s)d K (s) . If n r (s)n K (s) and d,,(s)d K (s) have a 
common factor, take it out; the zeros of this factor are fixed (i.e., fixed closed-loop 
poles) with respect to the gain k. Now, assuming there is no common factor, define 

n(s) \= n P (s)n K (s), a := order 

d(s) := d p (s)d K (s), V := order { 1 /( 5 )}. (11.35) 

Then the loop gain is L(s) = P(s)K(s)= Locate the poles and zeros of 
L(s) in the 5-plane. 

We now give a minimal set of rules that help in sketching the root locus. 


Rule 1: For k= 0, the root locus starts at the poles of L(s). 

Proof: The characteristic polynomial is d(s ) + kn(s) . . . 

Rule 2: As k — > +°° , Li branches of the root locus go to the zeros of L(s), and 

v - /u branches go to °° 

Proof: There are v branches of the root locus, that is, roots of d(s) + kn(s) = 0 . 

Now, for k > 0 : 


zeros of d(s) + kn(s) = zeros of —d(s)+ n(s). 

k 


(11.36) 
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Let p 0 be a closed-loop pole corresponding to k. Then 

yd(p 0 ) + n(p 0 ) = 0. (11.37) 

k 

If | Po| is bounded as k — > +°°, then 

lim - d(p 0 ) + n(p 0 ) = lim n(/? 0 ) = 0. (11.38) 

k-^+OO &— »+ oo 

That is, the pole p 0 converges to a zero ofL(s). Otherwise, |p 0 | is unbounded; 
that is, p 0 — > +°° . 

Rule 3: The root locus is symmetric with respect to the real axis. 

Proof: All complex poles come in conjugate pairs. . . 

Rule 4: A point on the real axis, not a pole or zero of L(s), is on the root locus if 

and only if it lies to the left of an odd number of real poles and real zeros (counted 
together) of L(s). 


Rule 5: For the branches of the root locus going to infinity, their asymptotes are 

described by 

^ poles of L(s)- ^ zeros of L(s) 

Center of asymptotes = . 

v-p 

2k + 1 

Angles of asymptotes = /rrad, k = 0,l,...,v — p — 1 . 

v-p 

Example 11.9: Sketch the root locus of the tracking system shown in Figure 

11.17, where 


P{s) = 


5 ( 0.25 + 1 ) 

25 3 + 105 2 +20’ 


K(s) = 1. 


We find p(s) = 25 3 + IO 5 2 + 20 + ks(0.2s + 1). The loop gain is L(s ) = P(s ) = 
2 ^+ ' 10 /+ 20 • ^ ts P°l es are at Pi , 2 =0.1747± y'1.356 and p 3 =-5.349. The root 
locus starts at these poles for k = 0, and two branches tend to the zeros 
z l = 0, z 2 = -5 of L(s) as k — > +°°. There is only one asymptote on the real line 
going to -00. A sketch of the root locus based on the preceding rules is shown in 
Figure 11.18. 
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FIGURE 11.18 Root locus of a closed-loop system with variable gain on 
the controller. 


The root locus is a technique for conducting interactive control analysis and de- 
sign. Factors limiting its usefulness include the following: 

■ The closed-loop poles do not completely characterize a system’s behavior. 

■ The root locus can be used for one varying parameter only. 

Thus, the root locus is a tool that can be useful for simple problems. It is best 
computed and plotted using a CAD software such as MATLAB. 

Example 11.10: Root locus using MATLAB 

Suppose we want to plot the root locus of a unity feedback control system with 
plant P(s) = s2 + ^ +4 and controller K(s) = k ^ for a controller gain k varying 
between 0 and 1000. The following MATLAB program does the job, producing the 
root locus in Figure 11.19. This M-file can be found on the companion CD-ROM 
in D:\Chapterl l\rootlocus.m 

%% rootlocus.m Root locus of a feedback control system 
% vector of gains 
K=0 : 1 : 1000; 

% loop gain 

numK= [ 2 1 ] ; 

denK=[ 1 -1]; 

numP=[ 1 ] ; 

denP=[ 1 2 4] ; 

numL=conv(numK,numP) ; 
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denL=conv (denK, denP) ; 
polesL=roots(denL) ; 
zerosL=roots(numL) ; 
L=tf ( numL , denL) ; 

% root locus 
rlocus ( L, K) ; 



FIGURE 11.19 Root locus of a closed-loop system using MATLAB. 



((Lecture 40: The Nyquist Stability Criterion)) 


THE NYQUIST STABILITY CRITERION 


The Nyquist criterion uses a plot of the frequency response of the loop gain, called 
the Nyquist plot, to determine the stability of a closed-loop system. It can also be 
used to find measures of stability robustness called the gain margin and the phase 
margin. These margins represent the additional gain or negative phase on the loop 
gain that would take the feedback system to the verge of instability. 

The Principle of the Argument and the Encirclement Property 

The Principle of the Argument states that the net change in phase (argument) of a 
transfer function G(s ) (as the complex variable s describes a closed contour C 
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clockwise in the complex plane) is equal to the number of poles of G(s) enclosed in 
C minus the number of zeros of G(s) enclosed in C, times 2n. 

This is a particular case of conformal mappings in the complex plane, where a 
closed contour is mapped to the locus of G(s) in the complex plane. One result that 
is of interest to us from conformal mapping theory is that a closed contour in the s- 
plane is mapped by G(s) to another closed contour in the complex plane. 

Another equivalent form of the principle of the argument is the encirclement 
property, which states that as a closed contour C in the s-plane is traversed once 
in the clockwise direction, the corresponding plot of G(s ) (for values of s along C) 
encircles the origin in the clockwise direction a net number of times equal to the 
number of zeros of G(s ) minus the number of poles of G(s) contained within the 
contour C. 

In applying this property, a counterclockwise encirclement of the origin is in- 
terpreted as one negative clockwise encirclement. 

The Nyquist Criterion 

The Nyquist criterion is an application of the encirclement property to the Nyquist 
plot of the loop gain to determine the stability of a closed-loop system. It provides 
a check for stability but says nothing about where the closed-loop poles are. The 
root locus can provide that information, but it requires analytical descriptions of the 
controller and the plant, that is, transfer functions. On the other hand, the Nyquist 
criterion can be applied to a plant or loop gain whose frequency response has been 
measured experimentally, but whose transfer function is unavailable. 

Recall our closed- loop stability theorem IV: the unity feedback control system 
is stable if and only if the transfer function 1 + K(s)P(s) has no closed RHP zeros, 
and no pole-zero cancellation occurs in the closed right half-plane when forming 
the loop gain K(s)P(s). Assume the latter condition holds and suppose the con- 
troller can be factorized as a pure gain times a transfer function: kK(s). Then for 
stability we must ensure that 1 + kK(s)P(s) has no closed RHP zeros. Further as- 
sume that 1 + kK(s)P(s) is proper. 

Nyquist Contour 

To use the encirclement property, we must choose a closed contour that includes 
the closed RHP. This contour is called the Nyquist contour and is shown in Figure 
1 1.20. It produces the Nyquist plot of a transfer function. The Nyquist contour in- 
cludes the entire imaginary axis (including + j°° ) and a semicircle of radius 
R — > oo to the right of the yew-axis. Because we assumed that 1 + kK(s)P(s) is 
proper, the Nyquist plot will remain at the constant value lim 1 + kK(s)P(s) =:b as 
the Laplace variable describes the infinite semicircle. 
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FIGURE 1 1.20 Definition of the Nyquist contour. 


If there are any poles or zeros on the yew-axis, they can be included in the 
Nyquist contour by indenting it to the left of (but infinitesimally close to) them. 

Nyquist Plot of L(s) 

The Nyquist plot of a transfer function L(s) is the locus of L(s) as the complex vari- 
able s describes the Nyquist contour. Because of the special shape of the Nyquist 
contour, the Nyquist plot is basically the locus of the frequency response L( jcd) in 
the complex plane as cw goes from -°° to +«=. In other words, for every fixed cw, the 
complex number L(jco) is represented by a point in the complex plane. The locus 
of all these points forms the Nyquist plot of L(jco). 

Example 11.11: The Nyquist plot of the first-order loop gain L(s)= * is 

shown in Figure 1 1 .21 . It starts at 0 (magnitude of 0, phase of n/2) at cw = then 
the phase of L(jco) starts to decrease, while its magnitude increases, as cw increases 
towards 0. At DC, L(y'O) = 1 (the phase is 0). The magnitude begins to decrease 
again as CO increases from 0 to +«, while the phase becomes negative. It eventually 
tends to -n/2 as cw — » . 

We now have all the elements in place to derive the Nyquist criterion. The 
transfer function 1 + kK(s)P(s) must not have any zero within the Nyquist contour 
for stability. The encirclement property states that 

#clockwise encirclements of the origin #closed RHP poles of (1 + kL(s )) 

by the Nyquist plot of (1 + kL(s)) = + *closed RHP zeros of (l + fcL(s)) 

o 

where # means “number of.” An equivalent stability condition is that the loop gain 
L(s) must not be equal to within the Nyquist contour. Also, since L(s) = 
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FIGURE 1 1.21 Nyquist plot of a first-order system. 


1 ! 1 
k (1 + kL(s )) - the number of encirclements of the point k by the Nyquist plot 

of L(s) is exactly the same as the number of encirclements of the origin by the 

Nyquist plot of 1 + kL(s). Furthermore, the closed RHP poles of L(s) are the same 

as those of 1 + kL(s). Therefore, we have the equivalent stability condition, called 

the Nyquist criterion. 

The Nyquist Criterion: Assuming that no pole-zero cancellation occurs in the 
closed right half-plane when forming the loop gain K(s)P(s), the unity feedback 
closed-loop system is stable if and only if: 

# counterclockwise encirclements of - — by the Nyquist plot of L{s) = # closed RHP poles of L(s). 


Remarks: 

■ The Nyquist plot is simply a representation of the frequency response of a sys- 
tem as a locus in the complex plane, parameterized by the frequency. As pre- 
viously mentioned, the Nyquist criterion could be checked for a loop gain 
whose frequency response is known, but not its transfer function. 

■ The frequency-response magnitude and phase plots of L(jco) can be used to 
draw its Nyquist plot: for each frequency, read off the magnitude and phase of 
L(jco) and mark the corresponding point in the complex plane. 

■ For LTI systems with a real impulse response (real coefficients for rational 
transfer functions), the Nyquist plot is symmetric with respect to the real axis. 
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Example 11.12: We want to check whether the feedback control system in 

Figure 1 1.22 is stable, where K(s) = ^ , P(s ) = () 5 ' + l and k = 2. 



FIGURE 11.22 Closed-loop system whose stability 
is assessed using the Nyquist criterion. 

The frequency response of the loop gain is L(jco) = K(jco)P(jco) = 

(0 5 yfo+i)Offl+D- Note that this loop gain is stable, as both poles are in the open LF1P. 
Moreover, there is no pole-zero cancellation. Therefore, the closed-loop system 
will be stable if and only if the net number of counterclockwise encirclements of 
the critical point ~ by the Nyquist plot of L(ja>) is 0. We see in Figure 1 1 .23 that 
for co — > ±°°, that is, on the infinite semicircle of the Nyquist contour, the Nyquist 
plot of L(jco) stays at the origin. We also have L{ j 0) = 1. 

0.8 

Im {L(jof)} 

0.6 

0.4 

0.2 

0 

- 0.2 
- 0.4 
- 0.6 

- 0.8 

-0 

Rc{/,(y©)> 

FIGURE 11.23 Nyquist plot of a second-order system. 

We can see that the point is to the left of the Nyquist plot, and hence the 
control system is stable. We can actually find the range of k’s for which the con- 
trol system would be stable. From the Nyquist plot, we can see that all points -- 
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to the left of the origin lie outside of the loop formed by the Nyquist plot, as well 
as all points to the right of 1 . This implies that the system is stable for k> 0 and 
for -1 < k < 0 . Therefore the complete range of gains to get stability is k>— 1 . 



((Lecture 41: Gain and Phase Margins)) 


STABILITY ROBUSTNESS: GAIN AND PHASE MARGINS 


Bode Plot of Loop Gain 

The Nyquist criterion gives us the ability to check the stability of a unity feedback 
system by looking at the Nyquist plot of its loop gain only. This is useful for at least 
two reasons. 

■ We can design a controller K(s) based on a plant transfer function P(s) or 
just its frequency response P(jco) and ensure that the closed-loop system 
will be stable by looking at the frequency response of the loop gain 
L(jco)= K(jco)P(jco) . We do not have to compute the characteristic polyno- 
mial (which cannot be done anyway if only P(jcd) is available). 

■ Closed-loop stability robustness can be assessed by looking at the Nyquist 

plot. Stability robustness refers to how much variation in the loop gain’s fre- 
quency response L(jco) (mostly coming from uncertainty in the plant’s fre- 
quency response) can be tolerated without inducing instability of the control 
system. Think of stability robustness as how far away the Nyquist plot is from 
the critical point - j . Here we are assuming that the Nyquist criterion was sat- 
isfied to start with, meaning that the nominal closed-loop system is stable. In 
this case, the closed loop will become unstable whenL(yft>) varies to the point 
of touching the critical point . 

Note that we will set k = 1 in the remainder of this section, such that the criti- 
cal point is now — 1, that is, the controller is thought to be the fixed transfer func- 
tion K(s). An example is shown in Figure 1 1 .24, where the nominal Nyquist plot of 
L(jco) (no closed RHP poles in Z.(s)) of a closed-loop stable system is perturbed to 
LpijoS), which touches the critical point -1. The closed-loop system with loop gain 
L p (jco) is unstable. 

By conjugate symmetry, the magnitude and phase plots (the Bode plot) of the 
loop gain’s frequency response L(jcd) convey the same information as the Nyquist 
plot. Therefore, it is possible to use the Nyquist criterion to check closed-loop sta- 
bility by looking at the Bode plot of L(jco), although this often proves to be diffi- 
cult. It is relatively easy only for low-order, “well-behaved” loop gains, which 
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FIGURE 11.24 Perturbed Nyquist plot of 
loop gain touching the critical point. 


fortunately make up many of the SISO control systems that we have to analyze or 
design in practice. 

For a stable loop gain, the Nyquist plot should neither encircle, nor touch the 
critical point -1 for closed-loop stability. Let us further restrict our attention to sta- 
ble and “well-behaved” loop gains (including many low-order, minimum-phase, 
proper rational transfer functions L(s) with positive DC gains.) For the Bode plot 
of a well-behaved loop gain, the above requirement translates into the following: 
the magnitude of the loop gain in decibels should be less than 0 dB at frequencies 
where the phase is -n or less, that is, ZL(jco) < -180°. 

Example 11.13: Consider the second-order plant model and pure gain controller 

P(s) = (0 iv+moon+n ’^fo) = 100 °f a unity feedback control system. The Bode plot 
of L(s) and its Nyquist plot are shown in Figure 1 1 .25. 

The loop gain is stable, and hence the Nyquist criterion is satisfied since the 
Nyquist plot of L{j(0) does not encircle the critical point -1 . On the Bode plot, we 
see that for any finite frequency, the critical point -1 (i.e., 0 dB and phase of 
-180°) is not reached. It would be if, for example, the phase of L(jcd) was -180° 
at the frequency where the magnitude is 0 dB (around 300 rad/s). This additional 
negative phase is similar to (but not the same as) a clockwise rotation of the lower 
part of the Nyquist plot (and a corresponding counterclockwise rotation of its upper 
part to keep the symmetry) until it touches the critical point. 

Gain and Phase Margins 

In this section, we assume that the Nyquist criterion is satisfied for L(jco) so that 
the closed-loop system is stable. Let us define the crossover frequency co co as the 
frequency where the magnitude of the loop gain is 0 dB (or 1). The crossover 
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FIGURE 1 1.25 Bode plot and Nyquist plot of a second-order loop gain. 


frequency is easy to find on the Bode plot. In the previous example, the crossover 
frequency is C0 c0 = 300 rad/s . We saw in that example that the closed-loop system 
was stable, but additional negative phase at the crossover frequency could destabi- 
lize it. The absolute value of this additional negative phase (at co co ) taking the 
control system to the verge of instability is called the phase margin (j> m of the feed- 
back control system. 

The phase margin is easy to read off a Bode plot of the loop gain. For the above 
example, the phase margin is approximately (j) m = 20° since the phase at the 
crossover frequency is ZL(jco co ) = -160°. This means that additional negative 
phase coming, for example, from a time delay of T seconds in the loop gain with 
frequency response e~ m could destabilize the control system. We can compute the 
minimum time delay that would destabilize the system as follows: 


n 


CO T = 0 

co 180 " 


n _ 20 n 

180co f „ “ 180 -300 


0.0012 s, 


=> T = 


(11.39) 
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which means that a time delay of 1.2 ms or more in the loop gain (e.g., if the plant 
is P(s ) = (0 1;+1 f )(001t+1) with T>1.2ms) would destabilize the feedback system. 
The phase margin can also be found on the Nyquist plot as the angle between the 
point where the locus crosses the unit circle and the real line. 

Similarly, the gain margin k m is defined as the minimum additional positive 
gain such that the closed-loop system is taken to the verge of instability. The gain 
margin is also easy to read off the Bode plot. It is the negative of the magnitude of 
the loop gain in decibels at the frequency where the phase is -180° (call it co _ JC ). 
On the Nyquist plot, the gain margin is the negative of the inverse of the real value 
where the locus of L(jco) crosses the real line in the left half-plane. 

For our previous example, the gain margin is actually infinite because 
co_ K = -H>o and -201og l0 |L(y°°)| = +°°. This means that no matter how large the 
controller gain is, the feedback system will always be stable. 

Example 11.14: Consider the second-order plant model P(s) = (o.n+ixo.ois+i) 

and the controller K(s) = — of a unity feedback control system. The Bode plot of 
L(s) and its Nyquist plot are shown in Figure 1 1.26. 
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FIGURE 1 1.26 Bode plot and Nyquist plot of a third-order loop gain. 
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For this example, the crossover frequency is approximately (O co = 7.8 rad/s , 
and the frequency where the phase is -180° is approximately co_ n = 33.7 rad/s. 
The phase margin is given by 

^L(jco co ) = -125° => <j> m = 55°. (11.40) 

The phase margin is also indicated on the Nyquist plot as the angle between the 
point where the locus crosses the unit circle and the real line. 

The gain margin is given by 

K =-2°log 10 \L{j( 0 _ K )\ = 22 dB. (11-41) 


SUMMARY 


In this chapter, we analyzed LTI feedback control systems. 

■ Feedback control has the ability to reject system output disturbances, reduce 
the effect of uncertainty, and stabilize unstable systems. 

■ We distinguished between two types of feedback control systems: regulators 
and tracking systems. 

■ Closed-loop stability is a necessary requirement for any feedback system. We 
gave four equivalent stability theorems for unity-feedback control systems. 
We also introduced Routh’s criterion, the root locus, and the Nyquist criterion 
as different means of assessing closed-loop stability. 

■ Two simple measures of closed-loop stability robustness were defined: the 
gain margin and the phase margin. 


TO PROBE FURTHER 


Feedback control systems are studied in detail in control engineering texts 
(Belanger, 1995; Kuo and Golnaraghi, 2002). For a more theoretical treatment of 
control systems, see Doyle, Francis and Tannenbaum, 1992. 


EXERCISES 


Exercises with Solutions 

Exercise 11. 1 

Consider the causal LTI unity feedback regulator in Figure 11.27, where P(s) = 


(s + l)(s 2 + 5V2.S + 25)’ 
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FIGURE 1 1 .27 Regulator of root locus Exercise 11.1. 


(a) Use properties of the root locus to sketch it. Check your sketch using 
MATLAB ( rlocus command). 


Answer: 

The loop gain is L(s) = kP(s)K(s ) = 


Ar(i-l)(i 2 +3^25 + 9) 

(s + l)(s + 2)(i + 3)(s 2 + 5 s/2s + 25) ' 


■ The root locus starts at the (open-loop) poles of L(s): -1, -2,-3, - ^ ± j 

3 3 

for k = 0. It ends at the zeros of L(s ): 1 ^ ±j ^ ■»,“ for k = +°°. 

■ On the real line, the root locus will have one branch between the pole at -1 and 
the zero at -2, and also one branch between the poles at -3 and -2 (Rule 4). 

■ Let V = deg{rf} = 5 and /u = deg{»} = 3. For the two branches of the root 
locus going to infinity, the asymptotes are described by 


V poles of L(s)~2 \ zeros of L(s) 

Center of asymptotes: = — — 

v-ju 

_ (-1-2- 3 -5^2)- (1-3^2) _ -1-2^2 
2 2 


Angles of asymptotes: 


2k + 1 


TC, 

v-p 


k = 0,1 


J K 12, k = 0 
[3^/2,k = l 


Root locus: See Figure 1 1.28. 

(b) Compute the value of the controller gain k for which the control system be- 
comes unstable. 
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FIGURE 1 1 .28 Root locus for Exercise 11.1. 


Answer: 

The characteristic polynomial is obtained: 
p(s ) = n(s) + d(s) 

= k(s - l)(r + 3yf2s + 9) + (s + 1)0 + 2)0 + 3)0 2 + 5 V2.v + 25) 
= s 5 +fl 4 s 4 + a 3 s 3 + a 2 s 2 + a x s + (-9k + 150). 


From the root locus, we see that the onset of instability occurs when a real pole 
crosses the imaginary axis at 0. At that point, we have 


pO)U =-9^ + 150 = 0 


, 50 
=> k = — 

3 


16.67. 


Exercise 11.2 


We want to analyze the stability of the tracking control system shown in Figure 
11.29, where /* 0 )= and * 0 )= 
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FIGURE 1 1.29 Tracking system of Exercise 1 1 .2. 


(a) Assess the stability of this closed-loop system using any two of the four 
stability theorems. 

Using Theorem T. We have to show that T(s), P~ l (s)T(s) and P(s)S(s) are all 
stable. 


10(4.v + l)(0.5s + 1) 

P(s)K(s ) _ (s — l)(0-ls + l) 2 _ 20s 2 + 45s + 10 

V ~ 1 + P(s)K(s) ~~ , 10(4$ + 1X0-5$ + 1) - 0.01s 3 + 20. 19s 2 + 45.8s + 9 
(5-l)(0.1.v + l) 2 

is stable (all three poles in LHP, strictly proper). The poles are -20 1 7, -2. 1 , and -0.2. 


10(0.5$ + 1) 


P~\s)T(s) = 


O.H + 1 

l | 10(4$ + 1)(0.5 $ + 1) 
+ ($-i)(o.n + i ) 2 


(O.lr +0.9$ -1X5$ + 10) 
0.01s 3 +20.19r + 45.8$ + 9 


is also stable (same poles as above, proper). 


P(s)S(s) = 


P(s) 

1 + P(s)K(s) 


4s + 1 

(s-l)(0.1$ + l) 

1 | 10(4s + l)(0.5s + l) 
+ (s-l)(0.1s + l) 2 


0.4s 2 + 4. Is + 1 
0.01s 3 + 20.19s 2 + 45.8s + 9 


is stable (same poles as above, strictly proper). Therefore the feedback system is stable. 

Using Theorem IT. We have to show that either T(s) or S(s) is stable and that 
no pole -zero cancellation occurs in the closed RHP in forming the loop gain. The 
latter condition holds, and 
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10(4s + l)(0.5s + l) 

P(s)K(s ) = ~(j-l)(0.1s + l) 2 = 20r + 45^ + 10 

S ~ 1 + P(s)K(s ) ~~ , 10(4, y + 1)(0.5,y + 1) “ 0.01s 3 + 20. 19s 2 + 45.8s + 9 

(s-l)(0.1s + l) 2 

is stable (all three poles in LHP, strictly proper). The poles are -2017, —2.1, and 
-0.2. Therefore the feedback system is stable. 

Using Theorem III : We have to show that the closed-loop poles, that is, the zeros 
of the characteristic polynomial p(s), are all in the open LHP. The plant and the 
controller are already expressed as ratios of coprime polynomials. 

p(s) = n K n p +d K d p = 0.01s 3 + 20. 19s 2 + 45.8s + 9 

All three closed-loop poles -2017, -2.1, and -0.2 lie in the open LHP, and 
therefore the feedback system is stable. 


Using Theorem IV: We have to show that 1 + K(s)P(s) has no zero in the closed 
RHP and that no pole-zero cancellation occurs in the closed RHP in forming the 
loop gain. The latter condition obviously holds, and 


1 + K(s)P(s) = 


1 

S(s) 


= 1 + 


10(4s + l)(0.5s + l) 
(s-l)(0.1s + l) 2 


0.01s 3 + 20.19s 2 + 45.8s + 9 
0.01s 3 + 0.19s 2 + 0.8s — 1 


All three zeros of this transfer function -2017, —2.1, and -0.2 lie in the open 
LHP, and therefore the feedback system is stable. 

(b) Use MATLAB to sketch the Nyquist plot of the loop gain L(s) = K(s)P(s). 
Give the critical point and discuss the stability of the closed-loop system 
using the Nyquist criterion. 


Answer: 

The Nyquist plot given in Figure 11.30 was produced using the Nyquist command 
in MATLAB. 

The loop gain has one RHP pole, and according to the Nyquist criterion, the 
Nyquist plot should encircle the critical point -1 once counterclockwise. This is in- 
deed what we can observe here, and hence the closed-loop system is stable. 

Exercise 11.3 

We want to analyze the stability of the tracking control system in Figure 11.31, 
where R(5) = I ^ T and K(s)= 7. 
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FIGURE 1 1.30 Nyquist plot of Exercise 1 1 .2(b). 



FIGURE 11.31 Tracking control system of 
Exercise 1 1 .3. 


Sketch the Bode plot in decibels (magnitude) and degrees (phase) of the loop 
gain (you can use MATLAB to check if your sketch is right). Find the frequencies 
C0 co and co_ n . Assess the stability robustness by finding the gain margin k m and 
phase margin (j) m of the system. Compute the minimum time delay in the plant that 
would cause instability. 

Answer: 

The loop gain is L(s ) = and its Bode plot is shown in Figure 1 1.32. 
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\LUg>)\ 



co (rad/s) 


FIGURE 1 1.32 Bode plot of loop gain in Exercise 1 1 .3. 


Frequency (0_ n is undefined, as the phase never reaches -180°. Thus, the gain 
margin k m is infinite, and the phase margin is (j> m = 58° at co cg = 1.3 rad/s. The min- 
imum time delay Tin the plant that would cause instability is obtained as follows: 


71 A\ 

COT = 

co 180 

n ± 58 n 

■ T = — (p m = — = 0.78 s. 


180m 


180-1.3 


Exercises 

Exercise 11.4 

Consider the LTI feedback control system shown in Figure 1 1.33. 
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plant 




FIGURE 1 1.33 Feedback control system of Exercise 1 1 . 4 . 


The transfer functions of the different causal components of the control system 
are K(s) = and ^0) = ^- 

(a) Compute the loop gain L(s) and the closed-loop characteristic polynomial 
p(s). Is the closed-loop system stable? 

(b) Find the sensitivity S(s) and complementary sensitivity T(s) functions. 

(c) Find the steady-state error signal of the closed-loop response y(t) to the 
input y d (t) = sin(f) . 

(d) Assume that the real parameter k is an additional gain on the controller; 
that is, the controller is kK(s). Sketch the root locus for the real parameter 
varying in k e [0,+°°). 

Exercise 11.5 

We want to analyze the stability of the tracking control system shown in Figure 
1 1.34, where P(s) = — - and K(s) = 10(0,5,9 +1) . Assess the stability of this 

v ' (0.01s + lX0.1s + l) i J 

closed-loop system using any two of the four stability theorems. 


yA*) + 

e(t) 

K(s) 

u (i) 

P(s) 

A 

J ^ 

k 

► 







y(t) 


FIGURE 1 1.34 Feedback control system of 
Exercise 1 1 . 5 . 


Answer: 
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Exercise 11.6 

Consider the LTI unity feedback regulator in Figure 1 1.35. 


0 


d 0 (t) 


+ 

e(t) 


u (t) 



P 

kK (s) 

► 

P(s) 



FIGURE 11.35 Feedback regulator of Exercise 1 1.6. 


The transfer functions in this regulator are P(s ) = , _ ( ^ )( K(s) = 

and k e [0,+°°) . Use properties of the root locus to sketch it. Check your sketch 

using MATLAB ( rlocus command). 

Exercise 11.7 

Consider the LTI feedback control system shown in Figure 1 1.36, where G a (s) = 

^ 3 , , K(s ) = 1} , and the plant model P is P(s) = s+ s ~ . 

(a) Compute the loop gain Us) and the closed-loop characteristic polynomial 
p(s). Is the closed-loop system stable? 

(b) Find the sensitivity function S(s) and the complementary sensitivity func- 
tion T(s). 

(c) Find the steady-state error of the closed-loop step response y(t), that is, for 
the step reference y d (t) = q(t) . 

(d) Assume that the real parameter k is an additional gain on the controller, 
that is, the controller is kK(s). Sketch the root locus for the real parameter 
varying in £e[0,+°°). 
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FIGURE 1 1.36 Feedback control system of Exercise 1 1 .7. 
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Answer: 


Exercise 1 1.8 

Sketch the Nyquist plots of the following loop gains. Assess closed-loop stability 
(use the critical point — 1.) 

(a) L(s) = 

(b) L(s) = 


q+if 


i 


(s+ncs-n 


Exercise 11.9 

We want to analyze the stability of the tracking control system in Figure 11.37, 
where P(s) = ^^ T) 


and K(s ) = 


e(t) 

K(s) 

u(t) 

P(s) 

k(0 

D ► 

L 

► 









FIGURE 1 1.37 Feedback control system of 
Exercise 1 1 .9. 


Hand sketch the Bode plot in decibels (magnitude) and degrees (phase) of the loop 
gain. You can use MATLAB to check if your sketch is right. Find the crossover 
frequency co co and the frequency where the phase is -180°: ( 0 _ n . Assess the 
stability robustness by finding the gain margin k m and phase margin <f) m of the sys- 
tem. Compute the minimum time delay in the plant that would cause instability. 


Answer: 



ON THE CD 


Exercise 1 1.10 

s + 2 

Sketch the Nyquist plot of the loop gain L(s) = (< + 1)(1 q i+1) . Identify the frequencies 
where the locus of L(jco) crosses the unit circle and the real axis (if it does.) 

Exercise 11.11 

Consider the spacecraft shown in Figure 1 1.38, which has to maneuver in order to 
dock on a space station. 
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FIGURE 1 1 .38 Spacecraft docking on a space station in Exercise 11,11. 


For simplicity, we consider the one-dimensional case where the state of each vehi- 
cle consists of its position and velocity along a single axis z. Assume that the space 
station moves autonomously according to the state equation 

x s (t) = A s x s (t ), 

where x s = , A s = ° * , and the spacecraft’s equation of motion is 

x c (t)= A c x c (t)+ B c u c (t) 


where x c = Zc , u c (t) is the thrust, A c = ° , and B c = ^ . 

(a) Write down the state-space system of the state error e:=x c -x s , which de- 
scribes the evolution of the difference in position and velocity between the 
spacecraft and the space station. The output is the difference in position. 

(b) A controller is implemented in a unity feedback control system shown in 
Figure 1 1 .39 to drive the position difference to zero for automatic docking. 
The controller is given by 


K(s) = 


100(5 + 1) 
0.015 + 1 ’ 


Re{5}>-100 


Find G(s ) and assess the stability of this feedback control system (hint: one of the 
closed-loop poles is at -10). 



FIGURE 11.39 Feedback control system of Exercise 11.11. 
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(c) Find the loop gain, sketch its Bode plot, and compute the phase margin 
of the closed-loop system. Assuming for the moment that the controller would 
be implemented on Earth, what would be the longest communication delay that 
would not destabilize the automatic docking system? 

(d) Compute the sensitivity function of the system and give the steady-state error 
to a unit step disturbance on the output. 


Answer: 
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((Lecture 42: Definition of the Discrete-Time Fourier Series)) 

I n this chapter, we go back to the study of discrete-time signals, this time fo- 
cusing on the frequency domain. We will see that periodic discrete-time signals 
can be expanded in a finite Fourier sum of complex harmonics. However, ape- 
riodic discrete-time signals require a continuum of complex exponentials to repre- 
sent them. Thus, the Fourier transform of a discrete-time signal is a continuous 
function of frequency. 


425 
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RESPONSE OF DISCRETE-TIME LTI SYSTEMS TO 
COMPLEX EXPONENTIALS 


Recall that complex exponentials of the type Cz" are eigenfunctions of discrete- 
time linear time-invariant (DLTI) systems; that is, they remain basically invariant 
under the action of delays. For example, they are used to find homogeneous re- 
sponses of difference systems. The response of a DLTI system to a complex expo- 
nential input is the same complex exponential with only a change in (complex) 
amplitude: z" *h[n] = H(z)z". The complex amplitude factor is in general a func- 
tion of the complex number z. To show that the complex exponential z" is an eigen- 
function of a DLTI system, we write, 

y[n\ = ^ h[k]x[n — k] = X, h[k\z n ~ k 

k=—°° k=—oo 

+oo 

= z n ^h[k]z~ k . (12.1) 

k=-°o 

+oo 

The system’s response has the form y[n] = H(z)z", where H(z) = X h[k]z~ k , 

k=-oo 

assuming that the sum converges. The function H(z) is called the z-transform of the 
impulse response of the system. For Fourier analysis, we will restrict our attention 
to complex exponentials that have z lying on the unit circle, that is, of the form e J " :n . 


FOURIER SERIES REPRESENTATION OF 

DISCRETE-TIME PERIODIC SIGNALS 

The complex exponential e J<0 ' n of frequency 0 ) t = is periodic with fundamen- 
tal period N and fundamental frequency co 0 := — = 0 ) 1 . The set of all discrete-time 
complex exponentials that are periodic with (not necessarily fundamental) period 
N is given by 

< b k [n\ = e ik0, °"=e , k = ...~ 2 ,- 1 , 0 , 1 , 2 ,.... (12.2) 

This set of harmonically related complex exponentials is actually redundant, as 

• 27r ,v2? r 

. . . j — n j(N+\) — n 

there are only N distinct exponentials m it. For example, e N = e N , so 
0 [n] = <t> N+l [n ] , and in general, for any integer r, 




( 12 . 3 ) 
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Remarks: 

jk — n 

■ The set of harmonically related complex exponentials <j) k [n] = e N are distinct 
only over an interval (TV) of N consecutive values of k (starting at any k). This 


set is denoted as {^[w]]^ . 

The set {(/> k [n]} k is orthogonal. To prove this, first consider the case k = r: 


p+N-l 


n=p 


p+N-\ 

1 


jk 

e 


In 

N‘ 


e 


-jk 


2 n 
N 


n=p 


p+N-l 

1 


j(k-k) 

e 


In 

N' 


= N. 


n=p 


(12.4) 


Then for k^r. 


p+N-l 

X [«]* 


n=p 


p+N-l 

s 


2 n . In 
ik — n — ir — n 

e N e N , 


n—p 


r,k k 


p+N-l 

s 


Kk-r) 

e 


In 

N‘ 


n=p 


let m = n - p, 


N—l ... ,2 n. 

j(k—r )— — ( m+p ) 

2> 

m = 0 


... . In N-l ... .In 

j(k~r )p— j(k-r)—m 

= e N y.e N 


j(k—r)p— 


= e 


f ./<* r) 2 * V ' 

l-e N 

](k-r)p ^ 

— 0 N 

( \ 

1-1 

j(k-r)— 

V 1 e J 

— ct 

j(k-r)— 

L l-e N ) 


= 0. (12.5) 


The fundamental period of distinct harmonically related complex exponentials 
is not necessarily AT for all. For example, the case N= 6 is considered in Table 12.1. 


TABLE 12.1 Frequencies of Discrete-Time Complex Harmonics for N = 6 



jO^-n 

e 6 =1 

.In 

e 6 

.Jin 

j2—n 

e 6 

.Jin 
/3— n 

e 6 

.In 

j4—n 

e 6 

. c 2n 

j 5—n 

e 6 

Frequency ®i 

0 

n 

3 

In 

K 

4n 

~Y 

5 n 

T" 

Fundamental frequency w 0 

In (or 0) 

n 

3 

In 

3 

K 

2n 

V 

n 

3 

Fundamental period 

1 

6 

3 

2 

3 

6 
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Fourier Series Representation 

We consider a periodic discrete-time signal of period N that has the form of a lin- 
ear combination of the exponentials in {^[w]} : 

k—n 

x[n\= Y, a k (f> k [n]= X a k e jk% " = £ a/ N " . (12.6) 

k=(N) k=(N) k={N) 


Noticing that the set |^ A [«]} t v of /V harmonically related complex expo- 
nentials is orthogonal, we can compute the coefficients a k by multiplying Equation 

2 K 

* -./« — n > # / v 

12.6 by (p k [n] = e N and summing over the interval of time ( N ) : 


_ • t - ln 

X = X e J N 

n=(N ^ n=(^N^ p=(^N 


. 2;r .. 2 tt 

IP — « — ik — n , . 

a e « e N = No.. (12.7) 

p k 


Hence, 


= Tt X 


, 2 ® 

- ik — n 

J N 


N „=(jv) 


( 12 . 8 ) 


The remaining question is, Can any discrete-time periodic signal x[n] of period 
N be written as a linear combination of complex exponentials as in Equation 12.6? 
To show that this is true, we need to show that the relationship between x{n\ and a k 
is invertible. In other words, given any x\n ] of period N, the corresponding set of 
N coefficients computed using Equation 12.8 should be unique, and vice-versa. 
Expanding and repeating Equation 12.8, and choosing k = 0,1, 2,...,iV-l as the 
interval (n), we obtain 


a 


o 


fl, = 


_ 1 _ 

N 

J_ 

N 


(40] + 41] + 42] + • • ■ + 4 n - 1]) 

f .2 k ,2k 2 .2 n 

40] + x[X\e’ T + x[2]e~ J ^~ + ■ ■ ■ + x[N - l]e~' * 


\ 

y 


^ M— 1 


( -j(N- 1 )— -j(N- 1)— 2 

40] + 41> N +x[2\e N +• 

V 


-W-iy— (w-i) ^ 

■ + x[N-lk w 

J 


(12.9) 
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which can be written in matrix-vector form as follows: 


«0 


fl, 

1 

_ a N- 1. 

” N 


1 
1 

1 e 


2n 


-j 2 * 2 
o N 


2k 2k 

-y(W-i)— -j(N- 1)—2 


f*<N I) 
9 N 


-yW-l)^(JV-l) 
o N 


40 ] 

41 ] 

42 ] 

x[A-l] 


( 12 . 10 ) 


The matrix in this equation can be shown to be invertible; hence, a unique set 
of coefficients {a^.} corresponds to each x\n\ of period N, and vice versa. 

The coefficients { a k} k - iN; are called the discrete-time Fourier series (DTPS) 
coefficients of x\ni\. The DTFS pair is given by 


4 n\ = X a k e jkw °" = 


a,e 


,, 2 x 

ik — n 
J N 


( 12 . 11 ) 


k=(N) 


= ^J J x[n]e- jkcv = ^-J j x[n]e 


■t 2n 
— ik — n 

J N 


N n t {N 


N „ = (n) 


( 12 . 12 ) 


where Equation 12. 1 1 is the synthesis equation (or the Fourier series of x[n]), and 
Equation 12.12 is the analysis equation. 

Remarks: 

■ The coefficients can be seen as a periodic sequence with leZ, as 

they repeat with period N. 

■ All summations are finite, which means that the sums always converge. Thus, 
the DTFS could be more accurately described as the discrete-time Fourier sum. 


Example 12.1: Consider the following discrete-time periodic signal x[/i] of pe- 

riod N- 4 shown in Figure 12.1. 
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- 9 — 9 - 
-4 -3 -2 -1 


x[u] 


1 <► f 


• — •- 


FIGURE 12.1 Discrete-time square 
wave signal. 


We can compute its four distinct Fourier series coefficients using Equation 
12 . 12 . 




n = 0 
3 




- J 4 " _ f 


n= 0 
3 


1 + e "' 2 


=i(w)=— • ^ 


2a/2 


1 J 1 , , ] , > 

= t 5» * =-(i +e -") = -(i-i)=o 


' «=0 
3 


^ n=0 ^ 


l+£ 


= I(l + y) = 4=^ 

4 l 2V2 


(12.13) 


Let us see if we can recover x[l] using the synthesis equation: 


.K 


3 .,ik 1 1 _ .71 .n 1 .n _ .k 1 1 

*[l] = X a / T = - + — pe'V 2 +0 + — =e J *e Jl = - + ^Re{e 4 } = 1 (12.14) 
2 2-\/2 2 y 2 2 y 2 


k = 0 



((Lecture 43: Properties of the Discrete-Time Fourier Series)) 


PROPERTIES OF THE DISCRETE-TIME FOURIER SERIES 

FS 

We will use the notation x\n\ <H> a, to represent a DTFS pair. The properties of the 
DTFS are similar to those of continuous-time Fourier series. All signals in the fol- 
lowing subsections are assumed to be periodic with fundamental period N, unless 
otherwise specified. The DTFS coefficients are often called the spectral coeffi- 
cients. The properties of the DTFS are summarized in Table D.9 in Appendix D. 
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Linearity 

The operation of calculating the DTFS of a periodic signal is linear. 

FS FS 

For x[n\<r^a k , y[n]^b k , if we form the linear combination z[ri\ = ax[ri\ + 
f3y[n\, a,/leC, we have 


z[n]<r^aa k + fib k . 


(12.15) 


Time Shifting 

FS 

Time shifting leads to a multiplication by a complex exponential. For x[n]<r^a k , 

FS -jk—n„ 

x[n- n 0 \<r->e N a k , (12.16) 

where n 0 is an integer. 

Remarks: 

■ The magnitudes of the Fourier series coefficients are not changed; only their 
phases are. 

■ A time shift by an integer number of periods, that is, of n Q = pN, p e Z 
does not change the DTFS coefficients, as expected. 


Time Reversal 

Time reversal leads to a “frequency reversal” of the corresponding sequence of 
Fourier series coefficients: 


FS 

x[-n\<r^a_ k . (12.17) 

Interesting consequences are that 

■ For x[n] even, the sequence of coefficients is also even ( a_ k = a k ). 

■ Forx[»] odd, the sequence of coefficients is also odd (a = -a ,). 


Time Scaling 

Let us first examine the periodicity of x im [n\:= x[mn] and x^Jn] (defined in 
Equation 12.18), where m is a positive integer. The first signal x, [n\ is called a 
decimated, or downsampled, version of jc[w]; that is, only every m th sample of x[n] 
is retained. It is periodic if 3 M , such that x[mn\ = x[m(n + M)] = x[mn + mM], 
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This condition is verified if 3p,M e Z, such that mM = pN , which is always 
satisfied by picking p = m, M = N . Therefore, the signal x im \ n\ is periodic of pe- 
riod N. However, its fundamental period can be smaller than N. For example, if N 
is a multiple of m, we can select p = 1, M = — , and the fundamental period of 
x im [n\ is M = In order to find the DTFS coefficients of x lm [n], we would 
need to use results in sampling theory for discrete-time signals. This will be cov- 
ered in Chapter 15. 

Consider the signal defined as 


fx [n/m], if n is a multiple of m 
\ 0, otherwise 


(12.18) 


where m is a positive integer. This is called an upsampled version of the original 
signal x\n\. Thus, the upsampling operation inserts m - 1 zeros between consecu- 
tive samples of the original signal. The upsampled signal is periodic as shown 
below, but its fundamental period is niN and its fundamental frequency is _ 


x-j. [ n + mN] 


[ x[{n + mN)/m\ = x\n / m + N] = x[n / w], if n is a multiple of m 
0, if n is not a multiple of m 


(12.19) 


Example 12.2: Upsampling of a periodic square wave signal is shown in Figure 

12 . 2 . 



FIGURE 12.2 Upsampling a discrete-time square wave signal. 
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The Fourier series coefficients of the upsampled signal x Tm \n\ are given by 

FS 1 

— a k , ( 12 . 20 ) 

m 

where { x a k } is viewed as a periodic sequence of period mN. 

Proof: 




1 X - ' — jk n 

mN 


= — X X[n/m]e 

n=0,m,..,m(N-l) 


.,2n 

- ik n 

mN 


1 


= — (7 X x W e 


™N p={N) 


-j kZ FTP 1 

= ~a k 

m 


( 12 . 21 ) 


Periodic Convolution of Two Signals 

FS 

Suppose that x[n ] and y[n ] are both periodic with period N. For x[n]<r^a , , 

FS 

y[n]<r^b k , we have 


2_! x[m]y[n- m]<r^Na k b k . (12.22) 

m=(N ) 


Remarks: 

■ The periodic convolution is itself periodic of period N (show it as an exercise). 

■ What is the use of a periodic convolution? It is useful in periodic signal filter- 
ing. The DTFS coefficients of the input signal are the a k s, and the b k 's are cho- 
sen by the filter designer to attenuate or amplify certain frequencies. The 
resulting discrete-time output signal is given by the periodic convolution 
above. But it is mostly useful for convolving signals of finite support: with suf- 
ficient zero-padding, we can pretend that each one of the zero-padded signals 
represents a period of a periodic signal and use Equation 12.22 to compute the 
convolution in the frequency domain. The zero padding has the effect of turn- 
ing the periodic convolution into an ordinary convolution. We can then obtain 
the corresponding time-domain signal by solving Equation 12.10. This idea 
leads to the discrete Fourier transform (DFT) and the fast Fourier transform 
(FFT) algorithm, which are widely used techniques although beyond the scope 
of this book. 
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Multiplication of Two Signals 

The time domain multiplication of the two signals defined earlier yields 

FS T-l 

x[n\y{n \< ^ a A-r (12.23) 

l=(N) 

that is, a periodic convolution of the two sequences of spectral coefficients. Thi s 
property is used in discrete-time modulation of a periodic signal. 


First Difference 

The first difference of a periodic signal (often used as an approximation to the 
continuous-time derivative) has the following spectral coefficients: 

FS -jk— , . 

x[n]-x[n -!]<->( \- e N )a k - (12.24) 


Running Sum 

The running sum of a signal is the inverse of the first difference “system.” Note that 
the running sum of a periodic signal is periodic if and only if a 0 = 0; that is, the DC 
component of the signal is 0. In this case, 


" FS 

Zj *!>]<-> 


1 

l 271 

(l~e J V 


-r 


(12.25) 


Conjugation and Conjugate Symmetry 

The complex conjugate of a periodic signal yields complex conjugation and fre- 
quency reversal of the spectral coefficients: 

x*[n\<Z>a* _ k ( 12 . 26 ) 

Interesting consequences are that 

■ For x\n\ real, the sequence of coefficients is conjugate symmetric ( a_ k = a*). 
This implies |a_*| = |a*|, Z(a_ k ) = -Z(a k ), fl 0 eR, Reln,^} = Re{r/ A }, 
\m{a_ k } = -\m{a k }. 

■ For x[»] real and even, the sequence of coefficients is also real and even 
( a_ k = a k g R). 
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■ For x [«] real and odd, the sequence of coefficients is purely imaginary and odd 
( a_ k = -a k e jW). 

■ For an even-odd decomposition of the signal x\n\ = x e \n\ + x o [n\, we have 
x r ,[n]<->Re{a k }, x a [n\ A j\m{a k }. 



((Lecture 44: Definition of the Discrete-Time Fourier Transform)) 


DISCRETE-TIME FOURIER TRANSFORM 


We now turn our attention to Fourier transforms of aperiodic discrete-time signals. 
The development of the Fourier transform is based on the Fourier series of a peri- 
odic discrete-time signal whose period tends to infinity. Consider the following pe- 
riodic signal x[n] of period N= 7, shown in Figure 12.3. 
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FIGURE 12.3 Discrete-time periodic signal. 


Define x [«] to be equal to x[n\ over one period, and zero elsewhere, as shown 
in Figure 12.4. 
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FIGURE 12.4 A periodic discrete-time signal corresponding 
to one period of the periodic signal. 
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Let us examine the DTFS pair of x[n] given by 


x — ^ jk — n 

E a k e * > 

(12.27) 

H n ) 


1 v-i -jk—n 

- E *[«> N ■ 

(12.28) 


Referring to Figure 12.4, if we pick the summation interval such that 
-n l < n <n 2 cz(N) , we can substitute x[n] for x[ri\ in Equation 12.6: 


1 2 K 1 +oo 

1 x — ' — lk — n 1 x — i 

= - y x[n]e N = - Y x[n]e 
N ~u,s N± t 


..in 
— ik — n 
J N 


(12.29) 


n={N^ 


Define the function 


X(e jco ):= £x [n]e~ J> 


r j(on 


(12.30) 


We see that the DTFS coefficients a k are scaled samples of this continuous 
function of frequency CO. That is, 


1 27T, 1 

= —X(e N ) = — X(e J%k ). 
N N 


(12.31) 


Using this expression for a k in Equation 12.27, we obtain 

= E “ X(e lk% )e Jk%n = — £ • (12.32) 

k =(N) N 2n k= ^ 

At the limit, as N — > +°° in Equation 12.32, we get 

■ 0) Q — > d co- 
rn kco n — > co . 

ii . . 2n i 

■ The summation over N — > °° small frequency intervals of width C 0 Q = — — > dco 
tends to an integral over a frequency interval of width 2n. 

■ x[«]— >x[n]. 

Then Equation 12.32 becomes 

x[n\ = — f X(e ja, )e ja,n dco, 

2n 


(12.33) 
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which, together with Equation 12.1 1, rewritten here for convenience. 


X(e JC0 ) = X x[n\e- J0]n , (12.34) 


form the discrete-time Fourier transform (DTFT) pair. Equation 12.33 is the syn- 
thesis equation, meaning that we can synthesize the discrete-time signal from the 
knowledge of its frequency spectrum. The function X{e’" > ) in the analysis equa- 
tion (Equation 12.34) is the Fourier transform of x[«], It is periodic of period 271 
as we now show: 

-poo -poo -poo 

X(e A(0+27t> )= X X[n\e~ m+27C) " = X x[n]e~ j,an e- J2m ‘ = X x[n]e- j0> " = X(e jm ). (12.35) 


Example 12.3: Consider the exponential signal x{n\ = a"u[n\, a e M, |a| < 1 , as 

shown in Figure 12.5 for 0 < a < 1 . 



FIGURE 12.5 Discrete-time 
exponential signal. 


Its Fourier transform is 


+oo +oo -I 

X(e j(0 ) = Y,a n e- j( ° n = £( ae~ j(0 ) n = — (12.36) 

77=0 77=0 1 

Note that this infinite sum converges because |ae“ y<B | = |a| < 1. The magnitude 
of X(e J0> ) for 0 < a < 1 is plotted in Figure 12.6. 

Example 12.4: Consider the even rectangular pulse signal of width 2 n 0 +1 as 

shown in Figure 12.7 for the case n 0 = 2. 
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FIGURE 12.6 Magnitude of Fourier transform 
of discrete-time exponential signal. 
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FIGURE 12.7 Rectangular pulse signal. 


Its Fourier transform is given by 


+oo n 0 

X(e ia, )= Yj x[n\e~ j01 " = e~ ian 

n=-<>° n=—riQ 


= e 


J(On o 


-j(Om 


1 _ ~jco(2n 0 +l) 

— Jun 0 1 g 

e jmi 0 _ g-j(o(n 0 +l) 

e~i ma gj° >< - n o +1/ 2) _ g-./®("o+v2) 

— e~ 1<0 ' 1 2 e' w ' 2 — e~ j<0/2 

_ sin co(n 0 +1/2) 
sin(cn/2) 


( 12 . 37 ) 
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This function is the discrete-time counterpart of the sine function that was the 
Fourier transform of the continuous-time rectangular pulse. Flowever, the function 
in Equation 12.37 is periodic of period 2n, whereas the sine function is aperiodic. 
The Fourier transform of a pulse with n 0 =2 is shown in Figure 12.8. 



FIGURE 12.8 Fourier transform of discrete-time 
rectangular pulse signal. 


Convergence of the Discrete-Time Fourier Transform 

We now give sufficient conditions for convergence of the infinite summation of the 
DTFT. The DTFT of Equation 12.34 will converge either if the signal is absolutely 
summable, that is, 


- 1-00 
n =— oo 


or if the sequence has finite energy, that is, 


(12.38) 


X <00 ' 


(12.39) 


In contrast, the finite integral in the synthesis Equation 12.33 always converges. 



((Lecture 45: Properties of the Discrete-Time Fourier Transform)) 


PROPERTIES OF THE DISCRETE-TIME FOURIER TRANSFORM 

F 

We use the notation *[«]<-> W(e /0> ) to represent a DTFT pair. The following prop- 
erties of the DTFT are similar to those of the DTFS. These properties are summa- 
rized in Table D.8 in Appendix D. 
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Linearity 

F 

The operation of calculating the DTFT of a signal is linear. For x\ri\<r^ X(e 1<0 ) , 

F 

y\n\<r^Y(e JC0 ) , if we form the linear combination z[ri\ = ax[n] + by[n] , a,btC, 
then we have: 


z[n]£>aX(e JC °) + bY(e jm ). 


(12.40) 


Time Shifting 

Time shifting the signal by n 0 e Z leads to a multiplication of the Fourier trans- 
form by a complex exponential: 


x[n— n Q \<r^e jm "" X(e jm ). (12.41) 


Remark: Only the phase of the DTFT is changed. 

Frequency Shifting 

A frequency shift by co 0 eK leads to a multiplication of x[n ] by a complex 
exponential: 




(12.42) 


Time Reversal 

Time reversal leads to a frequency reversal of the corresponding DTFT: 

x[-«]Ax(F j "). (12.43) 


Proof: 


^ x\—n\e J " >n = ^ x[rn]e jmm = X(e jm ) 


(12.44) 


Consequences: Forx[/7] even, X(e i<0 ) is also even; forxf/?] odd, X(e J<0 ) is also 
odd. 
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Time Scaling 

Upsampling (Time Expansion) 

Recall that the upsampled version of signal x\ri\, denoted as x. m [ n \ , has m - 1 
zeros inserted between consecutive samples of the original signal. Thus, upsam- 
pling can be seen as a time expansion of the signal. The Fourier transform of the 
upsampled signal is given by 


r t Jn]oX (e*“). (12.45) 

Note that the resulting spectrum is compressed around the frequency (0 = 0, 
but since X(e j0> ) is periodic of period 2jt, its compressed version can still have a 
significant magnitude around co = n, which is the highest possible frequency in 
any discrete-time signal. This energy at high frequencies corresponds to the fast 
transitions between the original signal values and the zeros that were inserted in the 
upsampling operation. Figure 12.9 shows the Fourier transform of a rectangular 
pulse signal x[«] before and after upsampling by a factor of 2, giving x l2 |«| . Al- 
though not shown in the figure, the phase undergoes the same compression effect. 
Notice how the magnitude of the upsampled signal is larger than the original at 
high frequencies (around co = n). Because of this effect, the upsampling operator 
is often followed by a discrete-time lowpass filter (more on this in Chapter 1 5). 




FIGURE 12.9 Effect of upsampling on the Fourier transform of a discrete-time 
rectangular pulse signal. 


Downsampling (Decimation) 

Recall that the signal x± m := x[mn] is a decimated or downsampled version of x[«]; 
that is, only every m th sample of x\n\ is retained. Since aliasing may occur, we will 
postpone this analysis until Chapter 15, where sampling is studied. 
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Differentiation in Frequency 

Differentiation of the DTFT with respect to frequency gives a multiplication of the 
signal by n : 


F 


dX(e Ja ) 

dco 


(12.46) 


Convolution of Two Signals 

For X(e ja> ), y[n\<r^Y(e 1<0 ), we have 

^ x[m\y[n-m]<r^X(e iC0 )Y(e J<0 ). (12.47) 


Proof: Under the appropriate assumption of convergence, to be able to interchange 
the order of summations, we have 


-join 


n =-° o m=- oo 


'y' j 'y' j x[m\y[n - m]e Jwn = ^ x[m ] ^ y[« - m]e 7 ‘ 

m=—oo n =- oo 

m=—oo p =— oo 




= X(e J ‘°)Y(e jC0 ). 


(12.48) 


Remarks: 

■ The basic use of this property is to compute the output signal of a system for a 
particular input signal, given its impulse response or DTFT. 

■ The convolution property is also useful in discrete-time filter design and feed- 
back controller design. 


Example 12.5: Given a system with h[n] = (-0.8)"«[n] and an input 

x[n] = (0.5)" u[n\, the DTFT of the output is given by 


Y(e ico ) = H(e ia )X(e iw ) = 


1 1 


(12.49) 
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We perform a partial fraction expansion of Y(e JW ) to be able to use Table D.7 
in Appendix D to obtain y\n\. Note that the first-order terms in the partial fraction 

A A 

expansion should have the form , _ U( . n , not e m_ a , which usually leads to a wrong 
solution. Let z = e Ja> for convenience. 

1 A E 

(l + O.Sz-^Cl-O.Sz- 1 ) " l + 0.8z _1 + DAT 

1 _ A 1 gq+o.Sz- 1 ) 

(1-0.5z-')^ 8 1-0.5Z- 1 

1 =Bl A(l-0.5z-') 

(l + 0.8z _1 ) z=05 l + 0.8z“‘ 

Finally, we use Table D.7 to get 

y[n\ = — (-0.8)”m[w] + — (0.5)"«[n]. (12.53) 

Multiplication of Two Signals 

With the two signals as defined above, 

x[n\y[n\<^^~ J X(e JV )Y(e Aa ~ v) )dv. (12.54) 

2k 

Remarks: 

■ Note that the resulting DTFT is a periodic convolution of the two DTFTs. 

■ This property is used in discrete-time modulation and sampling. 

First Difference 

The first difference of a signal has the following spectrum: 
x[n ] - x[n - 1] A( 1 - e- J,0 )X(e JC0 ). 



(12.55) 
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Running Sum (Accumulation) 

The running sum of a signal is the inverse of the first difference: 

X x[m\ A 1 _ ja X(e J< “ ) + 7iX(e j0 ) X S(co - kin). (12.56) 

m =- oo ^ ) k=-°° 

The frequency-domain impulses at DC account for the possibility that signal 
x[«] has a nonzero DC component X(e j0 ) 0. 

Conjugation and Conjugate Symmetry 

Taking the conjugate of a signal has the effect of conjugation and frequency re- 
versal of the DTFT : 


r‘[«]4lV“). (12.57) 

Interesting consequences are that 

■ Forx[«] real, the DTFT is conjugate symmetric: X (e jm ) = X*(e~ J0> ). This implies 

\X(e~ j01 )\ = \X(e i0, )\ (even magnitude), ZX(e~ jm )= -ZX(e iC0 ) (odd phase), X(e j0 ) e M, 
Re{X(e- jra )} = Re{X(e' ffl )} (even), lm{X(e- ja )} = -lm{X{e iw )} (odd) 

■ For x[n\ real and even, the DTFT is also real and even: X(e J "j = X(e~ ia> ) e R. 

■ For x\n~\ real and odd, the DTFT is purely imaginary and odd: 

X(e ja ) = -X(F J0, )e jR. 

■ For an even-odd decomposition of the signal x[n] = x e [n\ + x o \n ] , 
x>] ARe{X(e" B )}, x o [n] AyIm{X(^)} . 

Parsevai Equality and Energy Density Spectrum 

The Parsevai equality establishes a correspondence between the energy of the sig- 
nal and the energy in its spectrum: 

X d(0 - (12.58) 

«=-oo X7T ln 

The squared magnitude of the DTFT |x(e 7<B )| is referred to as the energy’- 
density spectrum of the signal x[w] . 


((Lecture 46: DTFT of Periodic and Step Signals, Duality)) 
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DTFT OF PERIODIC SIGNALS AND STEP SIGNALS 


Fourier transforms of discrete-time periodic signals can be defined by using im- 
pulses in the frequency domain. 

DTFT of Complex Exponentials 

Consider the complex exponential signal x[n ] = e " . Its Fourier transform is given 
by 


X(e jm ) = ]T x[n]e~ Jmn = £ e i%n e J( ° n = £ e ~ J(a ~ %) ‘ 


(12.59) 


This last sum does not converge to a regular function, but rather to a distribu- 
tion, that is, an impulse train. For example, consider the finite sum 

X = V _ g i(ffl-«) 0 )'vy e -j((o-co 0 )m _ sin[(-/V + 1 / 2)( ft) - ft> 0 )] 

w ^0 sin[(ffl-® 0 )/ 2] 

It is basically the DTFT of a rectangular pulse, but shifted in frequency, as 
shown in Figure 12.10. Notice that the amplitude of the main lobes grows with N, 
while their width decreases with N. Their area tends to 271. 


X(e J,v ) 

2A r +l 



FIGURE 12.10 Truncated Fourier transform sum of 
a complex exponential signal. 


Thus, as N —> 00 , we get an impulse located at co 0 for the DTFT of the com- 
plex exponential e J0>n " , and this impulse is repeated every 271 radians, since any 
DTFT is periodic of period 2 tc. 


+<50 


X N (e ia ) -» X(e im ) = Yj 2 ^(co -co q - 2 nl). 


(12.61) 
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Check: Inverse Fourier transform. Note that there is only one impulse per inter- 

val of width 27t. 


1 +OQ 

x[n\ = — [ Y 2x8(0) -co - 2 nl)e 1<0 "d(0 = e" v (12 62) 

2 n Li=-~ 

DTFT of the Step Signal 

Since the constant signal x[«] = 1 can be written as x[n\ = e'°" , it follows that its 
DTFT in the interval [-7T,7r] is an impulse located at co = 0. Thus, 


x[n\ = l<-> 2k8(co — 2kI). (12.63) 

I =^o 

In order to find the Fourier transform of the unit step u[n], for which the analy- 
sis Equation 12.34 does not converge, we write this signal as the limit of two 
exponential signals pieced together at the origin plus the constant 1/2, as shown in 
Figure 12.11: 


1 


1 


u\n \ = — l- lim — a ( "" l_1) w[ — (/7+ 1)]H — oc n u[n 1 

2 I 2 2 


(12.64) 



FIGURE 12.1 1 Piecewise exponential signal tending to the unit step. 


We already know that the DTFT of 2 a n u[n] is | ' ,,, , and by the time 


reversal and time shifting properties, we have oc (l,+1) u[-(n + 1)] <H>- 


1 e" 

2 1 - ae Ja 
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Taking the Fourier transform of the right-hand side of Equation 12.64 before tak- 
ing the limit, we obtain 


U(e jm ) = Y nS(co -2 nl) + lim 

a-> 1 


/=- 

+oo 


1 e 


JW 


1 1 

- + — 


2 1 -ae jm 2 1 -ae 


^ „ 1,. -e 1 (1 - ae~ J ) + {\-ae J ) 

= yn8{co-2nl) + -\im : — — — : 


l=- 

+oo 


+00 2 

= y nd(co - 2 nl) + — lim 

^ 2 a-* 1 


/=- 

+00 


(a + 1) - (a + l)e J0> 

^ (1 - ae jco )(1 - ae~ jco ) ) 


2(1 -e Ja> ) 


+oo J 

= y — 2?r/) H 

it 2^{\ — e 1 )(1 -e~ J ) ) 

+oo 2 

= ^nd(co-2nl) + ——. 

l=^° 1 e 


(12.65) 


p i 

Flence, the Fourier transform of the unit step is given by u[n\<r -> + 

X nS(co-2nk). 


From the Fourier Series to the Fourier Transform 

Recall that a periodic signal of fundamental period N can be represented as a 
Fourier series as follows: 


x[n\= y 


k=(N) 


a,e u = y 


J ka > o" . 


.,2 n 
J k ^7 n 
a N 


Using the DTFT formula and the above result, we obtain 


(12.66) 


x(e ja )= y y 

n =- oo Ic=(n} 


jk—n 

a.e N e~ jmn 

k 


= X a k £ 

k={N^j n.- ■■■ 


.. ,271 

-j(o>-k—)n 
c N 


2 n 


= y 2wa t y 8{(0-k— -2 kI) 


/=- 


iV 


= y 2 na k 8 (( 0 -k ^). 


(12.67) 
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Thus, we can write the DTFT of a periodic signal by inspection from the 
knowledge of its Fourier series coefficients (recall that they are periodic). 


Example 12.6: Let us find the DTFT of x[n\ = 1 + sin( 2 * n) - cos (— n) . We first 

have to determine whether this signal is periodic. The sine term repeats every three 
time steps, whereas the cosine term repeats every seven time steps. Thus, the sig- 
nal is periodic of fundamental period N- 21. Write 


x[n\ = 1-1 

2 j 


( 2x7 

e 
V 


21 


— e 


. 2x7 \ 
'' 21 


f .2x3 


.2x3 \ 


+ e~ J 21 


(12.68) 


The nonzero DTFS coefficients of the signal are a 0 = 1, a _ 7 = j - ,a 7 = -j 
_ _ | 2 2 

fl_ 3 - 0.3 - - ■ hence we have 


10 - 9 jr 

X{e jm ) = X 2n a k ^8(a)-k^—-27il) 

*=-10 i=-co 2 A 

°°^ 6tt 6tt 

= 1 + n X S(o) + 2 kI) + 5(co - — - 2nl) 

1 — 2 1 / — — 


21 

+jn'£ l S(co +^-- 2 nl)~ jn^ 8 ( 0 )- ^— 2 k 1 ) 


=l+x 


f\jr f\jr 14 71 14 K 

k5(co + — — 2 nl)+ n 8 (co - — - 2 rcl) + j 7 td(co + — — 2nl) - jn5{a - — — 2 nl) 


( 12 . 69 ) 


DTFT of a Periodic Discrete-Time Impulse Train 

Let us now find the DTFT of the discrete-time impulse train x\ri\ = X 8 [n - kN ] . 
Thi s signal is periodic of period N. Its DTFS coefficients are given by 

-1 N - 1 ,,2x 1 N - 1 2x -1 

a k = ' N " = ' N " = — > ( 12 . 70 ) 

iV n=0 n=0 iV 


and hence, the DTFT of the impulse train is simply a train of impulses in the fre- 
quency domain, equally spaced by ^ radians. 


X(en = l~ t S (co~k— 

tlN N 


2 n 
N 


1 


8(co-k—) 

N 


2 nl) 


( 12 . 71 ) 


Thi s transform is shown in Figure 12.12. 
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FIGURE 12.12 Impulse train and its Fourier transform. 


DUALITY 


There is an obvious duality between the analysis and synthesis equations of the 
discrete-time Fourier series. The Fourier series coefficients can be seen as a peri- 
odic signal, and the time-domain signal as the coefficients. Specifically, the spec- 
tral coefficients of the sequence a k are x[-»] . That is, we have 

FS 

x[n\<r^a k , (12.72) 

time fr eq 


FS 1 

a <-» — x[-k]. (12.73) 

n N 

time fm 

This duality can be useful in solving problems for which we are given, for 
example, a time-domain signal that has the form of a known spectral coefficient 
sequence whose corresponding periodic signal is also given. Properties of the 
DTFS also display this duality. For example, consider a time-shift and coefficient 
index shift (frequency shift): 


.kin 


x[n - n Q ]<r J >a k 


(12.74) 
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jm — n FS 

e N x[n]^a k _ m . (12.75) 

There is no such duality for the DTFT since it is continuous, whereas the sig- 
nal is discrete. 


SUMMARY 


This chapter introduced Fourier analysis for discrete-time signals. 

■ Periodic discrete-time signals of fundamental period N have a Fourier series 
representation, where the series is a finite sum of N complex harmonics. 

■ Many aperiodic discrete-time signals have a Fourier transform representation, 
for instance the class of finite-energy signals. The discrete-time Fourier trans- 
form is typically a continuous function of frequency, and it is always periodic 
of period 2jt radians. 

■ The inverse discrete-time Fourier transform is given by an integral over one 
period of 2k radians. If the DTFT is a rational function of e j0> , then a partial 
fraction expansion approach can be used to get the time-domain signal. 

■ The DTFT of a periodic discrete-time signal can be defined with the help of 
frequency-domain impulses. 


TO PROBE FURTHER 


For more details on Fourier analysis of discrete-time signals, see Oppenheim, 
Schafer and Buck, 1999. 


EXERCISES 

Exercises with Solutions 

Exercises 12.1 

Compute the Fourier series coefficients {a k } of the signal x[n\ shown in Figure 
12.13. Sketch the magnitude and phase of the coefficients. Write x [«] as a Fourier 


series. 
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FIGURE 12.13 Periodic signal of Exercise 12.1. 


Answer: 

The fundamental period of this signal is N = 6 and its fundamental frequency is 
( 0 f) = 6 . The DC component is a Q = 0 . The other coefficients are obtained using 
the analysis equation of the DTFS: 


1 ^ 

= - 2j x W e 


■A* 

— ik — n 
■ 6 


..2n ..An .,6 n .,8 n 107T A 

— ik — - ik — — ik — - ik — - ik — 

2 + £> 6 -e 6 -2e 6 -e 6 +e 6 


J 


n In An 5 n \ 

, — ik— — ik — — ik — ik — 

2(1 -(-!)*) + « 3 -e 3 -e' 3 +e 3 


J 


2(1 - (-1) A ) + (1 - (-1) A )e 3 - (1 - (-1)* )e 


~jk 


2 k N 




- jk ^ 
2 + e 3 -e' 3 

J 


V 


Numerically, 


a 0 = 0 ,a 1 = 1, a 2 =0,a 3 = 0 ,a 4 = 0, a 5 =1. 

All coefficients are real, as the signal is real and even. The magnitude and 
phase of the spectrum are shown in Figure 12.14. 

We can write the Fourier series of x[n\ as 

5 .2 jr .2 n 

x\n\ = ’y' j a k e jk0> "" = e 6 + e 6 . 

k = 0 
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FIGURE 12.14 Magnitude and phase of DTFS of Exercise 12 . 1 . 


Exercise 12.2 

(a) Compute the Fourier transform X(e JO> ) of the signal x[n] shown in Figure 
12. 15 and plot its magnitude and phase over the interval co e [-7T,7r] . 



FIGURE 12.15 Signal of Exercise 12 . 2 . 


Answer: 

X(e jm ) = [n]e- jmn 

n =— °o 

= e jo>2_ e j<o + l + e -ja,_ e -m 

= 1-2 jsinco + 2 jsin2co = 1-2 7 (sincn-sin 2 co) 

The magnitude given below is shown in Figure 12. 16 for co e . 

|X(e /<u )| = ^1 + 4[sincn-sin2cn]“ 

= 4 sin 2 co- 8sin(2m)sincu + 4sin z (2<y) 
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% - 3 - 2-101234 


CO 

FIGURE 12.16 Magnitude of DTFT of Exercise 12 . 2 . 


The phase is given by 


ZX(e' 0> ) = arctan 


2sin(2<y)-2sincn 

1 


and is plotted in Figure 12. 17 for co e [— 7T, 7 t] . 



FIGURE 12.17 Phase of DTFT of Exercise 12 . 2 . 
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Exercise 12.3 

Compute the Fourier transforms X(e'"’ ) of the following discrete -time signals, 
(a) x[n\ = [a" sin(co 0 n) + /5 n ]u[n], |a| < l,\/5\ < 1 . 


Answer: 


x[n\ = 


[2j V > 


u[n] 


= — (ae ico ' > )"u\n\ ( ae u[n] + (f5) n u[n] 

2 j 2 j 


Using Table D.7, we obtain the DTFT: 


X(e J0> ) 


2j 


1 


1 -ae 


-jiC0-O) 0 ) 


1 - ae 


1 

-j(o>+<a 0 j 


+ - 


1 -fie 


-JCO 


(-0.5j)(l-ae 


,-j(a)+(O 0 ) 


) + (0.5y)(l-ae 


-j(0J-(O Q )\ 


l-2acosco n e 1 +a e 


v 2„~j2co 


-+- 


1 — fie~ 


JO) 


-(0.5 j)ae 


-j(a>+a> 0 ) 


+ (0.5 j)ae 


-j(0)-0) 0 )\ 


1- 2a cos CO n e 101 +CCe 


-j2<0 


- + - 


1 - fie 


,-JO) 


1- 2a cos co n e JC0 + ore 


v 2 a ~j20) 


+ ■ 


1 — fie 


-JO) 


-a sin co 0 e JCO {l-[5e JW ) + l-2acosco 0 e ja + a 2 e j2co 
(1 -2a cos co 0 e~ J(0 + a 2 e~ j2co )(l- (5e~ JW ) 
l-a(sina> 0 + 2cosco 0 )e~ Jl ° + a(a + Psinco 0 )e~ j2co 
(1 - 2a cos co 0 e- Jm + a 2 e - j2co )(1 - j5e ~ ia ) ' 


(b) x[n] = (n[n + 2] - u[n - 3]) * ( u[n + 2] - u[n - 3]) , where * is the convolu- 
tion operator. 


Answer: 

First consider the DTFT of the pulse signal y[n\ := u[n + 2] - u[n - 3] , which is 

; sm(5/2m) 

sin(co/2) 
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Now, x[n\ = y[ri\ * y[«] , and hence, 


X(e JW ) = Y(e JW )Y(e Ja ) 

sin(5/2 co) 
sin(ft>/2) 


Exercises 

Exercise 12.4 

Given an LTI system with h[n] = u[n\ and an input x[ri\ = (0.8)" u[n ] , compute 
the DTFT of the output Y(e ]a> ) and its inverse DTFT y\n\. 

Exercise 12.5 

Consider the signal x[n\ = cos (-« + 2 )(j) n . 

(a) Is this signal periodic? If the signal is periodic, what is its fundamental 
period? 

(b) Compute the discrete-time Fourier series coefficients of x[«]. 

Answer: 

ON THE CD 


Exercise 12.6 

Compute the Fourier transforms X(e JC0 ) of the following signals: 

(a) x[m] = a''[sin(cu 0 «) + 2cos(m 0 «)]M[«], 

+°° 

(b) x[»] = (m[h + 2]-m[«-3])* X e JKk 8\n-\5k], where * is the convolution 
operator 

Exercise 12.7 

Compute the Fourier transform H(e'"') of the impulse response h[n] shown in 
Figure 12.18 and find its magnitude over the interval co e [— tt, n] . 

Answer: 


ON THE CD 
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4 

2 - 

i 1- 


n\ 


• i 


-1 -4 -3 -2 -1 

1 2 3 4 5 6 7 ft 

■ -1 


FIGURE 12.18 Signal in Exercise 12.7. 


Exercise 12.8 

Compute the Fourier transform X(e' m ) of the signal x[n] shown in Figure 12.19 
and sketch its magnitude and phase over the interval co e [-K, k \ . 



FIGURE 12.19 Signal in Exercise 12.8. 


Exercise 12.9 

Compute the Fourier series coefficients {a k } of the signal x\n\ shown in Figure 
12.20. Sketch the magnitude and phase of the coefficients. Write x[n] as a Fourier 
series. 


,r[«] 


i 

» ( 

1 « 

T -4 -3 -2 

» 4 

1 T 2 3 4 

> < 


-7 -6 -5 



-1 1 
-2 * 

> i 

| 5 6 7 n 


FIGURE 12.20 Periodic signal in Exercise 12.9. 
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Answer: 



ON THE CD 


Exercise 12.10 

Consider a DLTI system with impulse response h[n] = (-0A)"u[n\-(0.5) n ~ 2 u[n - 2\. 
Compute the output signal y[n\ for the input x[n ] = (0.2)" u[n\ . Use the DTFT. 


Exercise 12.11 


.n 

J — n _o 

Compute the Fourier transform X(e J0} ) of the signal x[n] = ne 8 a u[n — 3], 

\a\ < 1. 


Answer: 
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((Lecture 47: Definition and Convergence of the z-Transform)) 


R ecall that the Laplace transform was introduced as being a more general 
tool to represent continuous-time signals than the Fourier transform. For 
example, the latter could not be used for signals tending to infinity. In dis- 
crete time, the z-transform defined as a Laurent series plays the role of the Laplace 
transform in that it can be used to analyze signals going to infinity — as long as an 
appropriate region of convergence (ROC) is determined for the Laurent series. In 
this chapter, we will define the z-transform and study its properties. We will see 
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that the z-transform of the impulse response of a discrete-time linear time-invariant 
(DLTI) system, called the transfer function, together with its region of convergence, 
completely define the system. In particular, the transfer function evaluated on the 
unit circle in the complex plane is nothing but the frequency response of the system. 


DEVELOPMENT OF THE TWO-SIDED Z-TRANSFORM 


The response of a DLTI system to a complex exponential input z" is the same com- 
plex exponential, with only a change in (complex) amplitude: z" * h[n] = H(z)z n , 
as shown below. The complex amplitude factor is in general a function of the 
complex variable z. 

y\ri\ = h[k]x[n - k\ = h[k\z"~ k 

k=-~° k= 

+00 

= z" X h[k]z~ k 

k=-oo 

= H(z)z" (13.1) 

The system’s response has the form y[n] = H(z)z", where H(z)= X h[n]z~ n , 

n =— °o 

assuming that this infinite sum converges. The function H(z) is called the z-trans- 
form of the impulse response of the system. The z-transform is also defined for a 
general discrete-time signal x[n\. 

X(z):= ^x[n\z~", (13.2) 

n=—o o 

which in expanded form is seen to be a Laurent series: 

X(z) = ... + x[-3]z 3 Tx[-2]z 2 Tx[-1]z* +x[0] + x[1]z"' T x[2]z“ 2 T x[3]z“ 3 T.... (13.3) 

Note that the discrete-time Fourier transform (DTFT) is a special case of the 
z-transform: 

Too 

X(e jm ) = X(z) \ z=eM = X x[n]e- ]tm . (13.4) 

n =— oo 

In the z-plane, the DTFT is simply X(z) evaluated on the unit circle, as depicted 
in Figure 13.1. 
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1 Im W 


FIGURE 13.1 Relationship between the magnitudes of a z-transform and its 
corresponding Fourier transform. 


Figure 13.1 was done with the MATLAB script zTFmagsurface.m, which is lo- 
cated on the companion CD-ROM in D:\Chapterl3. 

Analogously, the continuous-time Fourier transform is the Laplace transform 
evaluated on the jco- axis. Thus, the j ( 0 -axis of the .v-planc in continuous time cor- 
responds to the unit circle of the z-plane in discrete time. 

Writing z = re J<0 , we can analyze the convergence of the infinite summation in 
Equation 13.2: 

X( re im ) = £ (x[k]r~ k )e j( ° k . (13.5) 

k=-°° 

We see that the convergence of the z-transform is equivalent to the conver- 
gence of the DTFT of the signal x[n]r~ n for any given circle in the z-plane of 
radius r. That is, 


X(re j(0 ) = f{r[nK"}. 


(13.6) 
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Thus, the convergence of the z-transform will be described in terms of disk- 
shaped or annular regions of the z-plane centered at z = 0 . Note that the exponen- 
tial weight r ~" , r > 0 multiplying the signal is either a constant-magnitude or 
decaying exponential ( r > 1), or a growing exponential ( 0 < r < 1). 

Example 13.1: The z-transform ofthe basic exponential signal x\n\ = a"u[n], a eC 
is computed as follows: 


j(z) = £fl"z "=£(az (13.7) 

n = 0 n = 0 

The ROC of this z-transform is the region in the complex plane where values 
of z guarantee that \az~ l \ < 1, or equivalently |z| > \a \ . Then 

X(z) = ^(az -1 )" = — = , z > U. (13.8) 

„=o 1 - az z-a 

A special case is the unit step signal u[n ] ( a = 1), whose z-transform is 


U{z) = 


1 


1 — z 


-1 



(13.9) 


Example 13.2: Consider the signal 


x\ri\ = 


v 3 y 


u[n ] + 2 


f i V 

v 2 y 


u[—n - 1], 


(13.10) 


Its z-transform is computed as follows. 


X(z)= £ 


v 3 y 


u[n ] + 2 


T v 

k 2 j 


u[-n - 1] 


=1 


«=o V 3 2 


z'"+2X 


n=~°\ 2 J 


= 1 


v 3 y 


+oo 

z-” + 4z^2" 

n = 0 
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1 4z 



z i 4z 

~T 1-2 z 



2 z(z-^) 
(z-^)(l-2z) 


The ROC ofX(z) can be displayed on a pole-zero plot as shown in Figure 13.2. 


— < z < — (13.11) 

3 2 



FIGURE 13.2 Pole-zero plot of a z-transform. 
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Note that a z-transform X(z) is rational whenever the signal x\n\ is a linear 
combination of real or complex exponentials. 


ROC OF THE Z-TRANSFORM 


Similar to the ROC of the Laplace transform, the ROC of the z-transform has 
several properties that can help us find it. The ROC is the region of the z-plane 
(z = re i<0 ) where the signal x[n]r~" has a DTFT. That is, the ROC consists of values 
of z where the signal x[n]r~ n is absolutely summable; that is, |x[k]|r“* <°°. 

k=—°° 

Convergence is dependent only on r, not on co. Hence, if X(z) exists at z 0 = re Ja>0 , 
then it also converges on the circle z = re Ja> , 0 < 0 ) < 2n . This guarantees that the 
ROC will be composed of concentric rings. It can be shown that it is a single ring. 
This ring can extend inward to zero, in which case it becomes a disk, or extend out- 
ward to infinity. However, it is often bounded by poles, and the boundary of the 
ring is open. We list some of the properties of ROCs of z-transforms. 

■ The ROC of X(z) does not contain any poles. 

■ If x[»] is of finite duration, then the ROC is the entire z-plane, except possibly 
z = 0 and z = °° . 

In this case, the finite sum of the z-transform converges for (almost) all z. The 
only two exceptions are z = 0 because of the negative powers of z and z = °° be- 
cause of the positive powers of z in X(z ) = X x[n]z~" . 

■ If x{n] is right-sided, then the ROC of X(z) contains the exterior of a disk that 
either extends to z = °oin the case x[n\ = 0, n < 0 , or does not include z = ° °. 
If in addition, X(z) is rational, then the ROC is the open exterior of a disk 
bounded by the farthest pole from the origin. 

■ If x[«] is left-sided, then the ROC of X(z) contains the interior of a disk that 
either includes z = 0 in the case x[«] = 0, n > 0 or does not include z = 0 . If in 
addition, X(z) is rational, then the ROC is the open disk bounded by the clos- 
est pole to the origin. 

■ Ifx[«] is two-sided, then the ROC of X(z) contains a ring with open boundaries 
in the z-plane. If in addition, X(z) is rational, then the ROC is an open ring 
bounded by poles ofX(z). 

Remarks: 

■ For a given pole-zero pattern, or equivalently, a rational X(z), there are a lim- 
ited number of ROCs that are consistent with the properties just described. 

■ The DTFT of a signal exists if the ROC of its z-transform includes the unit circle. 
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((Lecture 48: Properties of the z-Transform )) 


PROPERTIES OF THE TWO-SIDED Z-TRANSFORM 


The notation X(z) is used to represent a z-transform pair. In this section, 

we discuss the main properties of the z-transform. These properties are summarized 
in Table D.l 1 in Appendix D. 

Linearity 

The operation of calculating the z-transform of a signal is linear. 

z z 

For x[n]<->X(z),z e ROC x , j[«]t->7(z),zeR0C Y ; if we form the linear 
combination z[n] = ax[n ] + by[n], a,beC, then we have 

z[n]^aX(z) + bY(z), ROC □ ROC x n ROC y . (13.12) 


Time Shifting 

Time shifting leads to a multiplication by a complex exponential: 

z 

x[n- n 0 ]<r^z n °X(z), ROC = ROC x , except possible addition/removal of 0 or (13.13) 


Scaling in the z-Domain 


zfx[n]<r-> X 


( \ 
z 


ROC= zjROC„ 


(13.14) 


where the ROC is the scaled version of ROC x . Also, if X(z) has a pole or zero at 
z = a, then X(zj zf has a pole or zero at z = z (] a. An important special case is 
when z Q = e jco " . In this case |zjROC x = ROC x , and 


e^ 0 "x[n]4x(e“ yo, °z). (13.15) 

This corresponds to a counterclockwise rotation by an angle of (O 0 radians of 
the pole-zero pattern of X(z). On the unit circle (i.e., the DTFT), this rotation cor- 
responds to a frequency shift. 
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Time Reversal 

Reversing the time in signal x [77] leads to 


x[-n\<^X{z~ l ), ROC = ROC x _1 ; (13.16) 

that is, if z e ROC x , then z _1 e ROC . 

Upsampling 

The upsampled signal 


*t„,M := 


J x[n/m\, if n is a multiple of m 
\ 0, otherwise 


has a z-transform given by: 


(13.17) 


x f J«]4l(z"), ROC = ROC' x “. (13.18) 

o 0 ,2g* 

That is, if z () e ROC x , then z^ m = r' ) !m e m m e ROC, k = 1 . Also, 

if X(z) has a pole (or a zero) at z Q = r 0 e J< ”° , then the z-transform of x 1 m [n\ has 

m poles (or m zeros) at z' {) = r^e m ,k = 0,...,m-\ . The upsampling prop- 
erty can be interpreted through the power series representation of the z-transform 
in Equation 13.18: 


x (z m ) = X = X = X x u^ z (13.19) 

n =— 00 n=...—2m,—m,0,m,2m,... n=—°° 


Differentiation in the z-Domain 

Differentiation of the z-transform with respect to z yields 

«x[«]4-z-®^, ROC = ROC x . (13.20) 

dz 


Convolution of Two Signals 

The convolution of x[ii\ and y\n\ has a resulting z-transform given by 

x[n]*y[n\= ^ x[m]y[n-m]<r^X(z)Y(z), ROC 2 ROC x n ROC y (13.21) 


m=- 
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Remark: The ROC can be larger than ROC x nROC Y if pole-zero cancella- 

tions occur when forming the product X(z)Y(z). 


First Difference 

The first difference of a signal has the following z-transform: 

x[«]-x[«-l]<->(l-z -1 )X(z), ROC □ ROC x n|z e C : |z| > oj. (13.22) 


Running Sum 

The running sum, or accumulation, of a signal is the inverse of the first difference. 

— —X(z), ROC □ ROC x n {z e C : Izl > 1} (13.23) 

m— -oo (1-Z ) 


Conjugation 


x‘[«]Ax‘(z*), ROC = ROC x . (13.24) 

Remark: For x[«] real, we have: X(z) = X*(z*). Thus, ifX(z) has a pole (or a 

zero) at z = a, it must also have a pole (or a zero) at z = a*. That is, all complex 
poles and zeros come in conjugate pairs in the z-transform of a real signal. 

Initial-Value Theorem 

If x[«] is a signal that starts at n = 0, that is, x\n\ = 0, n < 0 , we have 

x[0] = limX(z). (13.25) 

Z— 

This property follows from the power series representation of X(z) : 

limX(z) = lim(x[0] + x[l]z _1 +x[2]z“ 2 + ...) = x[0], (13.26) 


Remark: For a transform X(z) expressed as a ratio of polynomials in z, the order 

of its numerator cannot be greater than the order of its denominator for this prop- 
erty to apply, because then x[n] would have at least one nonzero value at negative 
times. 
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Final-Value Theorem 

If x[n] is a signal that starts at n = 0, that is, x[n] = 0, n < 0 , we have 

limx[«] = lim(l-z _1 )x(z). (13.27) 

n — 2 — >1 ' / 



This formula gives us the residue at the pole z = 1 (which corresponds to DC). 
If this residue is nonzero, then X(z) has a nonzero final value. 

((Lecture 49: The Inverse z-Transform)) 


THE INVERSE Z-TRANSFORM 


The inverse z-transform is obtained by contour integration in the z-plane. This sec- 
tion presents a derivation of this result and discusses the use of the partial fraction 
expansion technique to invert a z-transform. 


Contour Integral 

Consider the z-transform X(z ) and let z = re' w be in its ROC. Then, we can write 

X(re jco ) = f{x[n\r- n ), (13.28) 

where T {•} denotes the operation of taking the Fourier transform. The inverse 
DTFT is then 

x[n}r~ n =X- X {x(re i '°)), (13.29) 

and hence, 

x[n] = r' l J : - x {x(re i,0 )\ 

= — f X{re ]m )e ]0,n d(0 

2n L 

= — f X(re j0> )(re im )" d CO. (13.30) 


From z = re Jm 


we get 
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so that 


dz = dco = (re jco )dco = rje i<0 d (0 

d(0 dco ' ' 

e~ i<0 z~ l dz 

=> dco = dz = 

Jr J 


x[n\ = — f X(re ](,y )(re J0> y dco 

2n L 

= d> X(z)z n z~ l dz 

2 7tj J c 

= (j> X(z)z"~ l dz , 

2 nj c 


(13.31) 


(13.32) 


where the integral is evaluated counterclockwise around the closed circular contour 
C := [z e C : |z| = r| lying in the ROC (or any other circle centered at the origin in 
the ROC) in the z-plane. Thus, the inverse z-transform formula is 


x\ri\ = <bx(z)z" l dz. (13.33) 

2 nJ c 

From the theory of complex functions, we find that this integral is equal to the 
sum of the residues at the poles of X(z)z"~ 1 contained in the closed contour (this 
is the residue theorem). That is, 

x\n] = Residues |x(z)z" _1 |. (13.34) 


Example 13.3: Suppose that we want to compute the inverse z-transform of 

X(z) = , |z| > |a| . First, we form the product X(z)z n ~ > = . Then, we take 

the circle |z| = \a\ + £,£>() as the closed contour in the ROC. The function has only 
one pole at z = a, and hence it has a single residue given by 

Res._ {x(z)z' !_1 } = (z — a)X(z)z"~' I = a" . (13.35) 

z a I z=a 

Now, because the ROC ofX(z) is the exterior of a disk (including infinity) of 
radius equal to the magnitude of the outermost pole, the corresponding signal must 
be right-sided and causal. Therefore the inverse z-transform of T(z) is 


x\n\ = a"u[n]. 


(13.36) 
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Partial Fraction Expansion 

An easier way to get the inverse z- transform is to expand X(z) in partial fractions 
and use Table D.10 (Appendix D) of basic z-transform pairs. This technique is 
illustrated by two examples. 


Example 13.4: Find the signal with z- transform 


X(z) = 


z + z 


(l+|z ')(z-|)' 3 


- < z <—. 
2 


(13.37) 


We first write X(z) as a rational function of z in order to find the poles and zeros: 


X(z) = 


z~ + 1 


(z + i)(z-f) 


1 I 

- < z 
3 1 



(13.38) 


It is clear that the poles are p x = - - , p 2 = - and the zeros are z = j, z, = —j. The 
pole-zero plot with the ROC is shown in Figure 13.3. 

Noting that the transform in Equation 13.38 is a biproper rational function, that 
is, the numerator and denominator are of the same order, we write the partial frac- 
tion expansion of X{z) as 


X(z) = 


1 + z 2 

(l + iz-‘)(l -}z-‘) 


= A + 


B 

1 + fz -1 


- + - 


C 




1-jz 


(13.39) 


where the ROCs of the individual terms are selected for consistency with the ROC 
f < | z | < L Coefficients A, B, and C are computed as follows. 

A = X(z) I = -6 (13.40) 

lz=0 


5 = (l + iz- 1 )W(z)[__ 1 

Z 2 


1 + z~ 2 

2 



C = (l- 



1 + z 2 

(i+K 1 )^ 



(13.41) 


(13.42) 




FIGURE 13.3 Pole-zero plot of a z-transform. 


Thus, 


X(z) = -6 + - — - — r + - — - — r <h> 4«] = -65[«]-3| -- u[-n- 1] + 4 - u[n\. (13.43) 
\ + \z \-\z 1 z J \ 3 ) 


iii iii 

z < — z>- 

I 1 2 I I 3 


Had the ROC of X(z) been specified as \z\> ' , then the inverse z-transform 
would have been 


1 1 

x\n] = -68\n\ + 3 — «[»] + 4 - «[»]. 

2 3 


(13.44) 


In the next example, the z-transform has a double pole. 
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Example 13.5: Find the signal with z- transform: 


X(z) = 


z 1 +z 2 


Z >-. 


(l + jz-'fil-jz- 1 ) 1 1 2 


(13.45) 


We write X(z) as a rational function of z in order to find the poles and zeros: 


X(z) = 


z(z + 1) 


(■ z + i) 2 (z-| )’ 2 


(13.46) 


The poles are p 1 =~\ (multiplicity m = 2), p 2 = ' and the zeros are 
Zj = 0, z 7 = — 1. The partial fraction expansion ofW(z) can be expressed as follows, 
where partial fractions of order 1 to m = 2 are included for the multiple pole: 


X(z) = 


z 1 +z 2 


(l + jz-yci-jz- 1 ) 1 + jz~' (1 + \z~ 1 ) 2 1-Iz 


— r. (13.47) 


where the ROCs of the individual terms are selected for consistency with the ROC 
|z| > 4. Coefficients A, B, and C are computed as follows. 


C = (l-|z- 1 )X(z) I = 


z 1 +z 2 


3 + 9 48 


(1 + iz -1 ) 2 i ,5. 2 25 


(13.48) 


B = (l + yz -1 ) 2 W(z) t = 


-1 . -2 
Z +Z 


2 


-2 + 4 6 


(13.49) 


A = X(z) — - 

(1 + lz ') 2 (l-{z ) 

-o 

25 25 25 


(13.50) 


Finally, the signal is obtained using Table D.10: 


*(*) = “7777 


48 1 

- + 


251 + \z~ l 5(1 + \z~') 2 25 1-jz- 1 


z 78 f 11 6 ill 48 fit 

++ x[n] = — u[n\ + —(n + 1) — u[n]-\ u[n\. (13.51) 

25 2 5 2 25 3 
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Power Series Expansion 

The definition of the z-transform is a power series whose coefficients equal the sig- 
nal values. Thus, given X(z), we can expand it in a power series and directly iden- 
tify the signal values to obtain the inverse z-transform. 


Example 13.6: Usually the power series of a z-transform is infinite, and we can use 
long division to obtain the signal values. For example, consider X(z)= 1 ; 

\z\ > 0.5 . Long division yields 


1 + 0.5z~ 1 + (0.5) 2 z~ 2 +... 
1 - 0.5z _1 j~l 

1- 0.5z~‘ 

0.5z _1 

0.5Z -1 -(0,5) 2 z~ 2 
(0.5) 2 z- 2 


(13.52) 


Note that the resulting power series converges because the ROC implies 
|0.5z“'| < 1 . Flere, we can see a pattern, that is, 

x[n\ = 1 8[n\ + 0.55[« - 1] + (0.5) 2 5[n - 2] + . . . + (0.5) k 8[n — k] + . . (13.53) 


so that 


x[n] = (0.5 )"«[«]. (13.54) 

Now suppose that the ROC is specified as the disk |z| < 0.5 for the same 

z-transform. Then, |(0.5) _1 z| < 1 , and we can expand X(z) = 77^^ = -l+fosr 1 - as 
a power series with positive powers of z by long division: 

—2 z — 2 z —2 z ... 

— 1 + 2 zj 2 z . 

2z-2 2 z 2 
2 2 z 2 

-<2 2 -)3 3 

2 z —2 z 

2 3 z 3 


(13.55) 
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Again, we can see a pattern: 

x[n\ = —2 8[n + 1] — 2 2 8[n + 2] — . . . — 2 k 5[« + k\ — . . (13.56) 


so that 


x[n\ = —2~ n u[-n - 1] = -(0.5)" u[-n - 1]. (13.57) 
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ANALYSIS AND CHARACTERIZATION OF DLTI SYSTEMS 
USING THE Z-TRANSFORM 


Transfer Function Characterization of DLTI systems 

Suppose we have the DLTI system in Figure 13.4. 





FIGURE 13.4 DLTI system. 


The convolution property of the z-transform allows us to write 

Y(z) = H(z)X(z), ROC □ ROC x n ROC H (13.58) 

so that we can find the response by computing the inverse z-transform of Y(z ): 

y[n] = Z l {Y(z)}. (13.59) 

The z-transform H{z) of the impulse response h\n\ is called the transfer func- 
tion of the DLTI system. The transfer function together with its ROC uniquely de- 
fine the DLTI system. Properties of DLTI systems are associated with some 
characteristics of their transfer functions (poles, zeros, ROC.) 
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Causality 

Recall that h[n] = 0 for 77 < 0 for a causal system, and thus the impulse response is 
right-sided. We have seen that the ROC of a right-sided signal is the exterior of a 
disk. If z = °° is also included in the ROC, then the signal is also causal because the 
power series expansion of H(z) does not contain any positive powers of z. There- 
fore, A DLTI system is causal if and only if the ROC of its transfer function H(z ) 
is the exterior of a circle including infinity. 

If the transfer function H(z) is rational, then we can interpret this result as fol- 
lows. A DLTI system with a rational transfer function H(z) is causal if and only if: 

1. The ROC is the exterior of a circle of radius equal to the magnitude of the 
outermost pole, and 

2. With H(z) expressed as a ratio of polynomials in z, the order of the nu- 
merator is less than or equal to the order of the denominator. 


Stability 

We have seen that the bounded-input bounded-output (BIBO) stability of a DLTI 
system is equivalent to its impulse response being absolutely summable, in which 
case its Fourier transform converges. This also implies that the ROC contains the 
unit circle. We have just shown necessity (the “only if’ part) of the following re- 
sult on stability: A DLTI system is stable if and only if the ROC of its transfer func- 
tion contains the unit circle. 

For a DLTI system with a rational and causal transfer function, the above sta- 
bility condition translates into the following: A causal DLTI system with rational 
transfer function H(z) is stable if and only if all of its poles lie inside the unit circle. 

Remarks: 

■ A DLTI system can be stable without being causal. 

■ A DLTI system can be causal without being stable. 


Example 13.7 Consider the transfer function of a third-order system with two 

,n_ _ .n_ 

complex poles at p x = 0.9e 4 , p 2 = 0.9e 4 and one real pole at p 3 = -1.5 : 


H(z) = 


1 

.n _ .n 

(l-0.9eV 1 )(l-0.9e~ 74 z“ 1 )(l + L5z“ 1 ) 


1 

(1 - 0.9V2Z- 1 + 0.8 lz -2 )(1 + 1 .5z _1 ) ' 


(13.60) 
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This system can have three ROCs: 

ROC 1 : |z : |z| < 0.9 j , corresponding to an anticausal and unstable system 

ROC 2: j z : 0.9 < |z| < 1.5 j, corresponding to a noncausal but stable system 

ROC 3: jz : |z| > 1.5j , corresponding to a causal and unstable system 

These ROCs are shown on the pole-zero plots in Figure 13.5. 



unstable, causal stable, noncausal 



unstable, anticausal 


FIGURE 13.5 Possible ROCs of transfer function. 
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Transfer Function Algebra and Block Diagram Representations 

Just like Laplace-domain transfer functions of continuous-time LTI systems can be 
interconnected to form more complex systems, we can interconnect transfer func- 
tions in the z-domain to form new DLTI systems. Transfer functions form an alge- 
bra, which means that the usual operations of addition, subtraction, division, and 
multiplication of transfer functions always result in new transfer functions. 

Cascade Interconnection 

A cascade interconnection of two DLTI systems, as shown in Figure 13.6, results 
in the product of their transfer functions: 

Y(z) = H 2 (z)H l (z)X(z), (13.61) 

H(z) = H 2 (z)H x (z), ROC □ ROCj nROC r (13.62) 



FIGURE 13.6 Cascade interconnection of 
transfer functions. 

Parallel Interconnection 

A parallel interconnection of two DLTI systems, as shown in Figure 13.7, results 
in the sum of their transfer functions: 

Y(z) = [H 2 (z) + H x (z)\X( Z ), (13.63) 

H(z) = H 2 (z) + H^z), ROC □ ROC, n ROC r (13.64) 




H,(z) 


X(z) 

► 

I 




0 

i L 


^ 

H 2 (z) 






+ Y(z) 

i ► 

+ 


FIGURE 13.7 Parallel interconnection of 
transfer functions. 
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Feedback Interconnection 

A feedback interconnection of two DLTI systems is depicted in the block diagram 
in Figure 13.8. Feedback systems are causal, but their poles are usually different 
from the poles of Hfz) and H 2 {z), so they have to be computed on a case-by-case 
basis. The ROC of the closed-loop transfer function H{z) can be determined after- 
wards as the exterior of a disk of radius equal to the magnitude of the farthest pole 
from the origin. 


E(z) = X(z)-H 2 (z)Y(z) 
Y(z) = H l (z)E(z) 


E(z) = X(z) — H 2 (z)H l (z)E(z) 

1 


E(z) = 

Y(z) = 


^ + H l (z)H 2 (z) 
Hfz) 

1 + H l (z)H 2 (z) 


X(z) 

X(z) 


(13.65) 


(13.66) 



FIGURE 13.8 Feedback interconnection 
of transfer functions. 



((Lecture 51: LTI Difference Systems and Rational Transfer Functions)) 


Transfer Function Characterization of LTI Difference Systems 

For systems characterized by linear constant-coefficient difference equations, the 
z-transform provides an easy way to obtain the transfer function, the Fourier trans- 
form, and the time-domain system response to a specific input. 
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Consider the TV^'-ordcr difference equation: 

N M 

^ J a k y[n-k] = ^ j b k x[n-k], (13.67) 

k= 0 k= 0 

which can be expanded into 

a Q y\ri\ + a x y\n- 1] H h a N y\n - N] = b Q x[n\ + b x x[n — 1] 3 \-b M x[n - M], (13.68) 

Using the time-shifting property of the z-transform, we directly obtain the 
z-transform on both sides of this equation: 

N M 

2Xz -< T(z) = 2V-‘*(z) (13.69) 

A:=0 k = 0 


or 


(flo + OjZ '+•■■ + a v z N )Y(z) = (b 0 + b l z 1 + --- + b M z M )X(z). (13.70) 


The transfer function is then given by the z-transform of the output divided by 
the z-transform of the input: 


H(z) = 


Y(z) 

X(z) 


b 0+ b l z~ i + - + b M z- M 
a f) + a x z~ x H 1- a N z~ N 


(13.71) 


Hence, the transfer function of an LTI difference system is always rational. If 
the difference equation is causal, which is the case in real-time signal processing, 
then the region of convergence of the transfer function will be the open exterior of 
a disk of radius equal to the magnitude of the farthest pole from the origin. The re- 
gion of convergence of a transfer function obtained by taking the ratio of trans- 
forms of specific input and output signals must be consistent with the ROCs of Y(z) 
and X(z). Specifically, it must satisfy ROC Y □ ROC x n ROC n . If the rational 
transfer function is given without an ROC, then knowledge of system properties 
such as causality or stability can help us find it. 


Example 13.8: Consider a DLTI system defined by the difference equation 


y[n\ + — y[rt. - 1] = 2 x[n - 1]. 


(13.72) 


Taking the z-transform, we get 


T(z) + ^z“ 1 T(z) = 2z _1 X(z), 


(13.73) 
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which yields the transfer function: 


H(z) = —— (13.74) 

l + -z _1 
7 

This provides the algebraic expression for H(z), but not the ROC. There are 
two impulse responses that are consistent with the difference equation. 

A right-sided impulse response corresponds to the ROC |z| > Y Using the time- 
shifting property, we get 


lY 

h[n\ = 2| — — 

3y 


«[«-!]. 


(13.75) 


In this case the system is causal and stable. 

A left-sided impulse response corresponds to the ROC | z | < Y Using the time- 
shifting property again, we get 


h[n\ = —2 


3 ) 


u[-n\. 


(13.76) 


This case leads to an unstable, anticausal system. It is hard to imagine the 
effect of an anticausal system on an input signal, especially if we think of the dif- 
ference equation as being implemented as a filter in a real-time signal processing 
system (more on this in Chapter 15). When the constraint of real time is not an 
issue, such as in off-line image processing or time-series analysis, then one can de- 
fine the time n = 0 at will, time reverse a signal stored in a vector in a computer 
without any consequence, use anticausal systems, etc. 


Block Diagram Realization of a Rational Transfer Function 

It is possible to obtain a realization of the transfer function of a DLTI difference 
system as a combination of three basic elements: the gain, the summing junction, 
and the unit delay. These elements are shown in Figure 13.9. 



unit delay gain summing junction 


FIGURE 13.9 Three basic elements used to realize any transfer function. 
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Simple First-Order Transfer Function 

Consider the transfer function H(z) = ^ , which corresponds to the first-order 

difference equation 


y[n\ = ay[n- X\ + x\n\. (13.77) 

It can be realized by a feedback interconnection of the three basic elements as 
shown in Figure 13.10. 


x[n\ + y[n\ 



FIGURE 13.10 Realization of a first-order transfer function. 


With this block diagram, we can realize any transfer function of any order in 
parallel form after it is written as a partial fraction expansion. 

Simple Second-Order Transfer Function 

Consider the transfer function H(z) = * r- It can be realized with a feed- 

v ' 1 + a t z+a 2 z 

back interconnection of the three basic elements in a number of ways. One way is 
to expand the transfer function as a sum of two first-order transfer functions (par- 
tial fraction expansion). The resulting form is called the parallel form, which is a 
parallel interconnection of the two first-order transfer functions. Another way is to 
break up the transfer function as a cascade (multiplication) of two first-order trans- 
fer functions. Yet another way to realize the second-order transfer function is the 
so-called direct form or controllable canonical form. To derive this form, consider 
the system equation 


Y(z) = -a l z l Y(z)-a^z 2 Y(z) + X(z). (13.78) 

This equation can be realized as in Figure 13.11 with two unit delays. 
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FIGURE 13.1 1 Realization of a second-order 
transfer function. 


Direct Form (Controllable Canonical Form) 

A direct form can be obtained by breaking up the general transfer function in Equa- 
tion 13.79 into two subsystems as shown in Figure 13.12. 


H( , = = b 0 + b l z~' + --- + b M z~ M 

-wr / \ _1 -ft 

X(z) a +az H ho 


(13.79) 


Assume without loss of generality that a 0 = 1 (if not, just divide all b- s by a 0 .) 



FIGURE 13.12 Transfer function as a cascade of two DLTI subsystems. 


The input-output system equation of the first subsystem is 

W(z ) = - ai z~ l W(z ) a N _ l z~ N+1 W(z) - a N z~ N W(z) + X(z), (13.80) 

and for the second subsystem, we have 

Y(z ) = b 0 W(z) + b^W(z) + • ■ ■ + b M _ lZ ~ M+1 W(z) + b M z~ M W(z). (13.81) 

The direct form realization is then as shown in Figure 13.13 for a second-order 
system. 
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FIGURE 13.13 Direct form realization of a second-order system. 



((Lecture 52:The Unilateral z-Transform)) 


THE UNILATERAL Z-TRANSFORM 


Recall from Chapter 7 that the unilateral Laplace transform was used for the causal 
part of continuous-time signals and systems. We now study the analogous unilat- 
eral z-transform defined for the causal part of discrete-time signals and systems. 
The unilateral z-transform of a sequence x\n\ is defined as 

+oo 

%(z):=^x[n]z-", (13.82) 

n = 0 

and the signal/transform pair is denoted as x[«]<->T(z) = UZ {x[«]} ■ 

The series in Equation 13.82 only has negative powers of z since the summa- 
tion runs over nonnegative times. One implication is that 

UZ [x[n]} = UZ {x[n]u[n]Y (13.83) 

Another implication is that the ROC of a unilateral z-transform is always the 
exterior of a circle. 

Example 13.9: Consider the step signal starting at time n = -2: 


x[n\ = u[n + 2 ], 


(13.84) 
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The bilateral z-transform of x[n\ is obtained by using the time-shifting 
property: 


X(z) = = — — , |z|>l, z^oo. (13.85) 

1 — z z — 1 1 1 

The unilateral z-transform ofx[»] is computed as 

*(*)=!*- 

«=o 

= |z|>l. (13-86) 

1 — z z- 1 ' ' 

Thus, in this case, the two z-transforms are different. 

Inverse Unilateral z-Transform 

The inverse unilateral z-transform can be obtained by performing a partial fraction 
expansion, selecting all the ROCs of the individual first-order fractions to be exte- 
riors of disks. The power series expansion technique using long division can be 
used as well. The series must be in negative powers of z. 

Properties of the Unilateral z-Transform Differing from 
Those of the Bilateral z-Transform 

The properties of the bilateral z-transform apply to the unilateral z-transform, 
except the ones listed below. Consider the unilateral z-transform pair T(z) 

in the following. 

Time Delay 

uz 

x[«-l]<->z T(z) + x[-l], ROC = ROC x , except possible addition of 0 (13.87) 

The value x\-l] originally at time n = — 1 “reappears” at n = 0, within the sum- 
mation interval of the unilateral z-transform, after the shift by one time step to the 
right. The result is the power series 

z _1 T(z) + x[— 1] = x[-\\+ x[0]z~' + x[\\z~ 2 +x[2]z" 3 H — (13.88) 


Time Advance 

uz 

x[» + l]<->zT(z)-zx[0], ROC = ROC x , except possible removal of 0 (13.89) 
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After a time advance, the first value of the signal x[0] is shifted to the left, out- 
side of the interval of the unilateral z-transform. The resulting power series is 

z9C(z) - zx[ 0] = x[l] + x[2\z ~ 1 + x[3]z“ 2 +■■■. (13.90) 


Convolution 


uz uz 

For signals that are nonzero only for n > 0, x x [n]<-^'X l (z), and x 2 [«]<-^T,(z), we 
have the familiar result 


uz 

x 1 [/i]*x^[/i]<->% i (z)%t(z), ROC □ ROCj nROC 2 . (13.91) 
Note that the resulting signal will also be causal since 
y[n\ = x l [n\*x 2 [n\ 

+oo 

= X X 1 [m]x 2 [n-m\ 

+oo 

= ^ X! [m]u[m]x 2 [n — m\i[n — >n] 

m =—° o 
n 

= Et \ m \ x j \n — m\ (13.92) 

m = 0 

and the last sum is equal to 0 for n < 0. 

Solution of Difference Equations with Initial Conditions 

The main use of the unilateral z-transform is for solving difference equations with 
nonzero initial conditions. The time delay property can be used recursively to show 
that 

uz 

x[n-m]<r J >z ”'T(z) + z m+1 x[-l]H l-z 1 x[-m + l] + x[-m], (13.93) 

Thus, we can deal with the initial conditions of a difference system by using 
the unilateral z-transform. 

Example 13.10: Consider the causal difference equation 

y[n] — 0.8y[« — 1] = 2 x[n\, (13.94) 

where the input signal is x[n\ = (0.5)"w[ n) and the initial condition is v| - 1 ] = y_ r 
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Taking the unilateral z- transform on both sides of Equation 13.94, we obtain 

^(z) - 0.8z _1 ^(z) - 0.8 v[-l] = 2 T(z) 

(l-0.8z“ 1 )'^(z)-0.8v , = — (13.95) 

l-0.5z“ 

which yields 


^(z) 


0-8V-. t 2 

( 1 - 0.8z _1 ) (1 - 0.8z _1 )(l- 0.5z“‘) ’ 


z >0.8. 


(13.96) 


The first term on the right-hand side is nonzero if and only if the initial condi- 
tion is nonzero. It is called the zero-input response of the system for the obvious 
reason that if the input is 0, then the output depends only on the initial condition. 

The second term on the right-hand side of Equation 13.96 is the response of the 
system when the initial condition is zero ( y_, = 0). It is called the zero-state re- 
sponse (we will study the notion of the discrete-time state in Chapter 17). Here, we 
need to expand the zero-state response in partial fractions: 


2 1.23 0.77 

(l-O.Sz-'Xl-O.Sz” 1 ) - 1-0.8Z” 1 l-0.5z _1 

Finally, the unilateral z-transform of the system is given by 


^(z) 


0.8y_j + 1.23 0.77 

1-0 8Z" 1 l-0.5z _1 ’ 

|z|>0.8 |z|>0.5 


and its corresponding time-domain signal is 


y[n\ = (0.8 y_, + 1.23)(0.8)"m[»] + 0.77(0.5)"m[«], 


(13.97) 


(13.98) 


(13.99) 


SUMMARY 


In this chapter, we introduced the z-transform for discrete-time signals. 

■ The bilateral z-transform was defined as a Laurent series whose coefficients are 
the signal values. It is a generalization of the discrete -time Fourier transform 
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that applies to a larger class of signals. Every z-transform has an associated re- 
gion of convergence, and together they uniquely define a time-domain signal. 

■ The DTFT of a signal is simply equal to its z-transform evaluated on the unit 
circle, provided the latter is contained in the ROC. 

■ The inverse z-transform is given by a contour integral, but in most cases it is 
easier to expand the transform in partial fractions and use Table D. 10 of basic 
z-transform pairs to obtain the signal. A power series expansion approach can 
also be used to obtain the signal in simple cases. 

■ Discrete-time LTI systems were studied using the z-transform. It was shown 
that the z-transform of the impulse response, that is, the transfer function and 
its ROC, completely characterize a system. 

■ Difference systems were shown to have rational transfer functions. These can 
be realized through an interconnection of three basic elements: the gain, the 
summing junction, and the unit delay. 

■ The unilateral z-transform considers only the portion of discrete-time signals at 
nonnegative times. Its time-delay property makes it useful in the solution of 
causal difference equations with initial conditions. 


TO PROBE FURTHER 


For a detailed coverage of the z-transform, see Oppenheim, Schafer and Buck, 
1999 and Proakis and Manolakis, 1995. 


EXERCISES 

Exercises with Solutions 

Exercise 13.1 

Sketch the pole-zero plot and compute the impulse response h[n] of the system 
with transfer function 


H(z) = 


z(\-0.Sz~ l ) 

0.8z + 0.64)(1 + 2z _1 ) 


and with ROC: 0. 8 < z < 2 • Specify whether or not the system is causal and stable. 
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Answer: 


H(z) = 


z(z- 0.8) 


z _1 (l — 0.8z -1 ) 


(z 2 -0.8z + 0.64)(z + 2) 

A A * 

(1-0.8/V 1 ) (l-0.8e J ^z _1 ) (1 + 2Z } 


0.8 < z <2 


(1- 0.8e' 3 z _I )(l - 0.8e'' 3 z" 1 )(l + 2z“') 


- + - 


C 


z<2 


r >0.8 


z>0.8 


The coefficients are given by 


A = - 


z“‘(l- 0.8z _1 ) 


1.25e 3 (1- e 3 ) 


1.25e“' 3 (l-e~' 3 ) 


(1- 0.8<? 3 z )(l + 2z ) 

1.25| --j —- -(---; — ) 
2 2 2 2 

R : 

(5.25- 1.5;^-) 


_ .2 n _ .n _ 2n _ .n 

if (l-e" ;T )(l + 2.5e'' 3 ) (3.5-e“' T + 2.5e“ J3 ) 


5(21 + jSsfi) 


'w2i- AS) 468 


= 0.224 + 0.0555; 


C = 


z _1 (l-0.8z _1 ) 


(1 - 0.8e 7 3 z _1 )(1 - 0.8e~ J 3 z _1 ) 
Thus, 


-0.7 


(1 + 0.4 + 0.16) 


- = -0.449 


rr , 0.224 + 0.0555 j 0.224-0.0555 j 0.449 

H(z) = - + 


(l-O.SeV 1 ) (l-0.8e _J,3 z _1 ) 


|z|>0.8 |z|>0.8 

The inverse z-transfomi is obtained using Table D. 10: 


h[n] = ( 0.22+ ;0.056) 


0.8e 


u[n] + (0.22 - ;0.056) 


0.8e 


m[»]-0.45(-2)"m[-h- 1] 


= 2 Re j / 3,1 (0.22 + ;0.056) [(0.8)" u[n] - 0.45(-2)" u[-n - 1], 


= 2(0.8)" [ 0.22 cos-n -0.056 sin-n ]«[«]- 0.45(-2) ,! «[-n- 1] 
V 3 3 


The pole-zero plot is shown in Figure 13.14. 
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The system is not causal since the ROC is a ring, but it is stable, as it includes 
the unit circle. 

Exercise 13.2 

Compute the inverse z- transform of X(z) = , |z| < 0.5 using the power 

series expansion method. 


X(z) = 


z 

(1-0.5 z~') 


2z 2 
2z — l’ 


Answer: 
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Long division yields 

-2z 1 2 -4z 3 -(2) 3 z 4 -... 

-1 + 2zj 2? . 

2z 2 -4z 3 

4z 3 

4z 3 -8z 4 
8z 4 

Note that the resulting power series converges because the ROC implies 
|2z| < 1 • The signal is 

x[n\ = -2 8{n + 2] - A8[n + 3] - 85[« + 4] . . . 

= -(^)" +1 w[-«-2]. 


Exercise 13.3 

Consider the stable LTI system defined by its transfer function 


H(z) = 


z 2 + z-2 
z 2 +Z + 0.5 


(a) Sketch the pole-zero plot for this transfer function and give its ROC. Is the 
system causal? 


Answer: 

The poles are p x = -0.5 + j0.5,p 2 = -0.5 - y'0.5 . The zeros are z x = -2,z 2 = 1 . The 
system is stable, so its ROC must include the unit circle. Because H(p°) is finite, 
we can conclude that the system is causal. The pole-zero plot is shown in Figure 
13.15. 

(b) Find the corresponding difference system relating the output y\n\ to the 
input x[n]. 


Answer: 

We first write the transfer function as a function of z _1 of the form 


H(z) 


1 + z~* — 2z~ 2 

l + z -1 +0.5z -2 
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FIGURE 13.15 Pole-zero plot of transfer function in Exercise 1 3.3(a). 


The corresponding difference system is 

y\n\ + y[n - 1] + 0.5y[n - 2] = x[n] + x[n - 1] - 2x[n - 2], 
(c) Sketch the direct form realization of this system. 

Answer: 

The direct form realization of the system is given in Figure 13.16. 



FIGURE 13.16 Direct form realization of transfer 
function in Exercise 13.3. 
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Exercise 13.4 (a bit of actuarial mathematics using the unilateral z-transform...) 

The balance of a bank account after each year with interest compounded annually 
may be described by the difference equation 

y[n\ = (l + r)y[n -\\ + x[ri\, 

where r is the annual interest rate, y[n] is the account balance at the beginning of 
the (77 + l) st year, the input “signal” x[n] = M(u[n\- u[n- L]) is composed of L 
consecutive annual deposits of M dollars, and the initial condition y[— 1] = y_, is the 
initial amount in the account before the first deposit. 

(a) Is this system stable? 


Answer: 

The system is unstable since the system is causal and the pole 1 + r is larger than 
1 , that is, outside of the unit circle. 

(b) Use the unilateral z-transform to compute ^(z). 


Answer: 

Taking the unilateral z-transform on both sides, we obtain 


^(z) - (l + r)(z _1 ^(z) + y[— 1]) = 'X(z) 

(l + r)y[-l] T(z) 

1 — (l + /’)z _1 1 — (l + 7')z _1 

(l + r)y[-l] M{\-z~ l ) 


ty(z) = 

%Z) = 


1 — (l + 7'jz 1 |^1 — {\ + r^z * J (1 — z ') 

(l + 7')y[-l](l - z _1 ) + M(\- z~ L ) 

[l-(l + r)z _I ](l-z _I ) 
more useful form: 


(i+d 

|v[-l]+M^V* 


1 — (l + 7’)z * 



(c) Find the annual deposit M as a function of the final balance in the account 
after L years, y[L - 1] , and the interest rate r. Compute the annual deposit 
M if you want to accrue $ 1 00,000 after 20 years at 5% annual interest rate 
with an initial balance of = $1000 . 
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Answer: 

The account balance at the beginning of the ( n + l) st year is 


y[n] = Z~ l {^(z)} 


= Z~ l \ 


(l + r)y[— 1]+M^ = V 


[i-fl + rjz- 1 ] 

L- 1 n _ k 

= [(l + r)y[-l]J(l + r) u\n\ + + u[n-k ]. 

*=o 

When the last payment is made at « = L - 1 , we get 


M = 


y[L - 1] = [(1 + r)y[— 1]](1 + r) i_1 + Afj(l + r) L “ w 

k=0 

= (l + r) L y[-l] + M^(l + r) m , 

m = 0 

which yields 

y[L — 1] — (l + r) L y[— 1] _ y[L-l]-(l + r) L y[-l] _ r[y[L-l]-(l + r) L y[-l]] 


M = 


1(1 +of 


r[y[L-l]-(l + r) L y[-l]' 
0 . 05 [$ 100000 -( 1 . 05 ) 2( 


1~(1 + 0 L 
l-(l + 0 


(l + r) L -l 


( 1 . 05) 20 - 1 


= $ 2944 . 


Exercises 

Exercise 13.5 

Compute the z-transform of each of the following signals and sketch its pole-zero 
plot, indicating the ROC. 
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(a) x[ri\ = a" cos(co 0 n + 9)u[n], |a|>l. Use the values a = 1.5, co 0 = — , 
6 = -~ for the pole-zero plot. 

(b) x\n] = u[n + 4]- u[n] 

(c) x[n\ = (—2)"u[—n + 3] 


Answer: 



ON THE CD 


Exercise 13.6 

Compute the inverse z-transform of X(z) = 0.2 < |z| < °° using the power 

series expansion method. 

Exercise 13.7 

Consider the following so-called auto-regressive moving-average causal filter S 
initially at rest: 

S: y[n] - 0.9 y[n - 1] + 0.8 \y[n - 2] = x[n] - x[n - 2] 

(a) Compute the z-transform of the impulse response of the filter H(z) (the 
transfer function) and give its ROC. Sketch the pole-zero plot. 

(b) Compute the impulse response h[n] of the filter. 

(c) Compute the frequency response of the filter. Plot its magnitude. What 
type of filter is it (lowpass, highpass, or bandpass)? 

(d) Compute and sketch the step response s[n] of the filter. 


Answer: 



ON THE CD 


Exercise 13.8 

z -3 — 1 2 z -4 

Consider a DLTI system with transfer function H(z) = ( -l 08)(z + Q8) - 
( a) Sketch the pole-zero plot of the system. 

(b) Find the ROC that makes this system stable. 

(c) Is the system causal with the ROC that you found in (b)? Justify your 
answer. 

(d) Suppose that H(e J, °) is bounded for all frequencies. Find the response of 
the system y[n] to the input x[n\ = u[n\ . 
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Exercise 13.9 

Compute the inverse z-transform x[n\ of X(z)= |z|>0.4 using the 

method of long division and sketch it. 


Answer: 



ON THE CD 


Exercise 13.10 

Sketch the pole-zero plot and compute the impulse response h[n] of the stable sys- 
tem with transfer function 


j j , , 2000z 3 + 1450z 2 +135z 

H(z) = . 

(100z 2 -81)(5z + 4) 

Specify its ROC. Specify whether or not the system is causal. 

Exercise 13.11 

Consider the DLTI system with transfer function H(z) = Z ~ 1 Q4 • 

(a) Sketch the pole-zero plot of the system. 

(b) Find the ROC that makes this system stable. 

(c) Is the system causal with the ROC that you found in (b)? Justify your 
answer. 

(d) Suppose that H(e ja> ) is bounded for all frequencies. Calculate the response 
of the system y[n] to the input x[n] = u[n]. 


Answer: 
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((Lecture 53: Relationship Between the DTFT and the z-Transform)) 

W e have seen that the discrete-time Fourier transform (DTFT) of a 
system’s impulse response (the frequency response of the system) exists 
whenever the system is bounded-input bounded-output stable or, 
equivalently, whenever the region of convergence (ROC) of the system’s transfer 
function includes the unit circle. Then, the frequency response of the system is 
simply its transfer function H(z) evaluated on the unit circle \z\ = 1, that is, z = e JC ". 
In this chapter, we discuss the geometric relationship between the poles and zeros 
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of the z-transform of a signal and its corresponding Fourier transform. It is possi- 
ble to estimate qualitatively the frequency response of a system just by looking at 
the pole-zero plot of its transfer function. For example, referring back to Figure 
13.1, complex poles close to the unit circle will tend to raise the magnitude of the 
frequency response at nearby frequencies. 

We will look in some detail at the connections between the frequency re- 
sponses of first-order and second-order systems and their time-domain impulse and 
step responses. Finally, the analysis and design of discrete-time infinite impulse re- 
sponse filters and finite impulse response filters will be discussed. In particular, the 
window design technique of finite impulse response filters will be introduced. 


GEOMETRIC EVALUATION OF THE DTFT FROM 
THE POLE-ZERO PLOT 


If we write the rational transfer function H(z) of a causal stable system in the pole- 
zero form, 


H(z) = A 


(z-z,)-(z-zj 

(z- Pl )---(z- P N )’ 


then its magnitude is given by 


H(z) = A 


1 


Z ~ Z M 

Z -Pi 


z ~Pn 


(14.1) 


(14.2) 


Evaluating this magnitude on the unit circle, we obtain 



A 



(14.3) 


Since the system is assumed to be stable, all poles lie inside the unit circle, but 
the zeros do not have that restriction. The magnitude of the frequency response, as 
a function of frequency CO varying over the range [— 7r,TC], can be analyzed qualita- 
tively as the point e J0> moves along the unit circle. The contribution of each pole 
and zero to the magnitude can be analyzed by viewing \e i<0 — p k \, \e Ja> — zj as the 
length of the vector from the pole to the point e J(0 and from the zero to the point e J0 \ 
respectively. In particular, 


■ A pole p k = r, <r * close to the unit circle will tend to increase the magnitude at 
frequencies 0 ) ~ 6 k because the distance between e J0> and p k = r k e J6t in the 
z-plane is small. 
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■ A zero z = r k er l close to the unit circle will tend to decrease the magnitude at 
frequencies co~6 k . 

The phase of H(e J( ”) is given by 

ZH(e j(0 ) = ZA + Z(e ja> -z,) + Z(e i<0 - z 2 ) + •• • + Z(e J<0 - z M ) 

- Z(e JW -p x )~ Z(e J<0 -p 2 ) Z(e jm -p M ). ( 14.4) 

Thus, the total phase is the sum of the individual angles of the pole and zero 
factors e' 0> - p , e j0> - z seen as vectors in the z-plane and the phase of the gain A. 

First-Order Systems 

Consider the first-order causal system with \a\ < 1: 


H (. z ) = - — = 

1 -az z- a 


\z\>\a\. 


(14.5) 


This system is stable, and hence it has a Fourier transform given by 


Hie 10 ’ ) : 


1 - ae~ J e jm -a 


(14.6) 


The geometric interpretation described above can be depicted on the pole-zero 
plot shown in Figure 14.1, where a is real, 0 < a < 1. 



FIGURE 14.1 Pole-zero plot showing the vectors 
associated with the pole-zero form of a first-order 
transfer function with one real positive pole. 



500 Fundamentals of Signals and Systems 


When the tip of the vector v, is at 1 (to = 0), the magnitude of v 2 is minimum, 
and hence the magnitude of H(e J<0 ) is maximized as |A/(e"")| = ^| = pj- When co 

goes from 0 to n, or from 0 to —n, the length of v 2 increases monotonically, which 
means that the magnitude will decrease monotonically. Hence, this is a lowpass filter. 
Thus, for 0 < a < 1, the magnitude plot will look like the one shown in Figure 14.2. 



FIGURE 14.2 Magnitude sketch of the 
frequency response of a first-order transfer 
function with a positive pole. 


The phase ZH(e jw ) is given by the angle of v, minus the angle of v 2 : 
ZH(e j(0 ) = Zv 1 -Zv 2 
= CO- arctan I 


f sincu-Im{«} ' 


V 

= co - arctan f - 


cos co- Re{c/} 

y 


smw 


for a ( 


\ cos co -a J 

Thus, the phase plot looks like the one sketched in Figure 14.3. 


( 14 . 7 ) 



FIGURE 14.3 Phase sketch of the 
frequency response of a first-order transfer 
function with a positive real pole. 
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For the case -1 < a < 0, the vectors are shown on the pole-zero plot of Figure 
14.4. 



FIGURE 14.4 Pole-zero plot showing the vectors 
associated with the pole-zero form of a first-order 
transfer function with one real negative pole. 


When the tip of the vector v, is at 1 (CO = 0), the magnitude of v 2 is at its 
maximum, and hence the magnitude of H(e jco ) is minimized as H(e Jm ) | = jTj'pj- 

When co goes from 0 to n, or from 0 to -7t, the length of v 2 decreases monotonically, 
which means that the magnitude will increase monotonically. At the highest fre- 
quencies CO = ±n , the magnitude of v 2 is at its minimum, so the magnitude of 
H(e jco ) is at its maximum. Hence, this is a highpass filter, and its magnitude plot 
will look like the one in Figure 14.5 for -1 < a < 0. 



FIGURE 14.5 Magnitude sketch of the 
frequency response of a first-order transfer 
function with a negative pole. 
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The phase ZH(e j,J> ) is again given by the angle of v, minus the angle of v 2 as 
expressed in Equation 14.7. It should look like the phase sketched in Figure 14.6. 



FIGURE 14.6 Phase sketch of the 
frequency response of a first-order transfer 
function with a negative real pole. 


Second-Order Systems 

Consider the stable second-order causal system with poles at p l2 = re ±JB , 0 

1 z 2 


H(z) = 


1 — 2? - cos0z l +r 2 z 2 z 2 — 2rcos9z + r 2 


z > r. 


< r < 1: 
(14.8) 


The impulse response of this system is obtained from Table D.10 and by using 
the linearity and time-advance properties of the z-transform: 


h[n\ = r" sin((« + 1 )Q)u\n\. 

sin 6 


Its Fourier transform is given by 






e j2a> — 2 r cos Oe i<0 + r 2 
e J2a 

(e j(0 — re J6 )(e jm — re ~' B ) 


(14.9) 


(14.10) 


The magnitude of H(e J0y ) can be analyzed qualitatively by looking at the pole- 
zero plot in Figure 14.7 showing the vectors as defined above. 
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FIGURE 14.7 Pole-zero plot showing the vectors 
associated with the pole-zero form of a second-order 
transfer function with complex poles. 


i i 2 

The magnitude is given by H(e jco ) | = = jk|7] = , which gets large as the 

frequency approaches ±0 (see Figure 14.8). 



FIGURE 14.8 Magnitude sketch of the 
frequency response of a second-order transfer 
function with complex poles. 


It is clear that the peaks on the magnitude sketch of Figure 14.8 will get larger 
as the poles get closer to the unit circle (r— >1), the limit being poles sitting 
directly on the unit circle and peaks going to infinity. Thus, r has an effect similar 
to the damping ratio £ of continuous-time second-order systems. 

The phase of H{e j(0 ) is given by twice the angle of v 3 minus the sum of the an- 
gles of V! and v 2 : 
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ZH(e Ja ) = 2 Zv 3 - Zv, - Zv 2 


f 

= 2(0- arctan 

V 


sinct)- ImjpJ ' 
costy-Rej/'jj^ 


f 

- arctan 

V 


sinry-Im{/? 2 } 

coso>-Re{/> 2 } 




y 


(14.11) 


The phase might look like the one sketched in Figure 14.9, although it varies 
greatly with pole locations. Typically, the closer the poles are to the unit circle, the 
sharper the phase drop near co= 6, since the angle of the vector v, changes more 
rapidly with co in that frequency band. 



FIGURE 14.9 Phase sketch of the 
frequency response of a second-order 
transfer function with complex poles. 



((Lecture 54: Frequency Analysis of First-Order and Second-Order Systems)) 


FREQUENCY ANALYSIS OF FIRST-ORDER AND 
SECOND-ORDER SYSTEMS 


In this section, we look in a bit more detail at the frequency responses of first-order 
and second-order discrete-time linear time-invariant (DLTI) systems. 


First-Order Systems 

Let us consider again a first-order causal, stable system with |a| < 1: 

1 z i i i i 

H(z) = — = , z >U. (14.12) 

1-az z-a 11 11 


Its Fourier transform is given by 
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Its impulse response is 

h[n] = a"u[n\, (14.14) 

and its unit step response is computed as the running sum of its impulse response: 

n n i «+l 

s\n\ = 'S' a k u[k\ = S a k = u[n\. (14.15) 

. *=o x ~ a 

The magnitude of the parameter a plays a role similar to that of the time con- 
stant rof a continuous-time first-order system. Specifically, u determines the rate 
at which the system responds. For small | a , the impulse response decays sharply 
and the step response settles quickly. For a\ close to 1, the transients are much 
slower. Figure 14.10 shows the step responses of two first-order systems, one with 
a = 0.5 and the other with a = 0.8. 



-5 0 5 10 15 20 25 30 « 

FIGURE 14.10 Step responses of two first-order DLTI 
systems with a real positive pole. 

From a frequency point of view, the lowpass frequency response of the system 
corresponding to small \a\ has a wider bandwidth than for |u close to 1. Thi s is eas- 
ier to see when the frequency response H(e JC0 ) is normalized to have a unity DC 
gain: 

|H(0|= (l-o)— 1 —^ 

1 — a 

(1-ocosco) 2 + (flsincu) 2 
1 — a 

(1 + a 1 — 2a cos co) yi 


(14.16) 
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The magnitude in Equation 14.16 is plotted in Figure 14.1 1 for the cases a = 
0.5 and a = 0.8. 



- 3.14 - 2.355 - 1.57 - 0.785 0 0.785 1.57 2.355 3.14 co 

FIGURE 14.1 1 Magnitude of the frequency responses of first-order 
transfer functions with positive poles. 

The phase changes more abruptly around DC for c/ close to 1, as shown in 
Figure 14.12. 

f sin m ' 

ZH(e J<0 ) = (O - arctan , for a 6 IR. (14.17) 

\cosco-a J 



FIGURE 14.12 Phase of the frequency responses of first-order 
transfer functions with positive poles. 
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Second-Order Systems 


± J0 

— irn J 


We now turn to a second-order causal, stable system with poles at p l 2 = re 
0 <?•<!; 


H(z) = - 


1 


l-2rcos0z 1 + r 2 z 2 z 2 -2rcosdz + r 2 
Its frequency response is given by 


,y'2 o> 


H(e im ) = 


e j2o> - 2r cos 0e Ja + r 2 


whose magnitude is 
\H(e JW )\ = 


e J2a> — 2 r cos Oe J<0 + r 2 


\z\>r. 


( 14 . 18 ) 


( 14 . 19 ) 


\e ja> — re \e ja> — re je 


\e j(m+B) -r\\e J(m - B) -r\ 


[^1 + r 2 -2rcos((iU + 0)J 2 |^l + r 2 -2rcos(ft>-0)J 


( 14 . 20 ) 


We see that the magnitude will peak around CO = ± 6 . The DC gain is obtained 
by substituting co = 0 in this expression, and we get 


\H(e j0 )\ = 


1 


[l + r 2 -2rcos0] 


( 14 . 21 ) 


For comparison, let us normalize the system so that its DC gain is unity for any 
pole parameters r, 6: 


H(z) = 


l + r 2 -2rcos0 
1 - 2 r cos 9z~ l + r 2 z~ 2 


z > r. 


( 14 . 22 ) 
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Then, 


men 


1 + r 2 -2rcos0 


[l + r 2 -2rcos(« + 0)] 2 [l + r 2 -2rcos(co-0)J 


i • 

I- 


( 14 . 23 ) 


Figure 14.13 shows the frequency response magnitude of the second-order 
system for 0 = \ and two values of pole magnitude, namely r = 0.6 and r = 0.8. 


2.5 n 


f\ A 

/ \ / 
v- 5 - / 

/ -- \ / .. \ 
!/ n ''\\ 


0.5 


-3.14 -2.355 -1.57 -0.785 


0.785 1.57 2.355 3.14 


FIGURE 14.13 Frequency response magnitude of second-order transfer 
functions with two pole magnitudes. 


The phase of the frequency response for 9 = ^ in Equation 14.24 is shown in 
Figure 14.14 for r = 0.6 and r = 0.8. 


ZH(e JC0 ) = 2(0 - arctan 


^ sin m-/' sin 0 '' 


cosco-rcosd 


- arctan 


^ sinco + rsin# ' 


cos (O -r cos 9 


( 14 . 24 ) 


The impulse response of this system for 6 = - is 


h[n] = \f2r" sin 


( „ + D^ 


u[n\. 


( 14 . 25 ) 
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r = 0.8 i .5 


\ 

A 1 

\ °- s 

\ \ 

0 

-0.5 
-1 
-1.5 


. //(>:• ') 


r = 0.6 


3.14 -2.355 -1.57 -0.785 0 q,785 1.57 2.355 3.14 

\ 

\''' 


FIGURE 14.14 Frequency response phase of second-order transfer 
functions with two pole magnitudes. 


This impulse response is shown in Figure 14.15, again for the cases r = 0.6 and 
r = 0.8. 


h [ n \ 



FIGURE 14.15 Impulse responses of second-order 
transfer functions with two pole magnitudes. 


We can see that the impulse response for r = 0.8 displays larger oscillations, 
which corresponds to the higher peaks in the frequency response. 

((Lecture 55: Ideal Discrete-Time Filters)) 


51 0 Fundamentals of Signals and Systems 


IDEAL DISCRETE-TIME FILTERS 


Ideal frequency-selective filters are filters that let frequency components over a 
given frequency band (the passband) pass through undistorted, while components 
at other frequencies (the stopband) are completely cut off. 

The usual scenario where filtering is needed is when a noise w\n\ is added to a 
signal x\ri\, but the noise has most of its energy at frequencies outside of the band- 
width of the signal. We want to recover the original signal from its noisy measure- 
ment. Note that the “noise” can be composed of other modulated signals as in the 
frequency division multiplexing technique. 

Ideal Lowpass Filter 

An ideal lowpass filter with the proper bandwidth can recover a signal x[«] from its 
noisy measurement x\n\ as illustrated in the filtering block diagram of Figure 
14.16. 


M’[n] 



FIGURE 14.16 Typical discrete-time 
filtering problem. 


In this idealized problem, the noise spectrum is assumed to have all of its en- 
ergy at frequencies higher than the bandwidth W of the signal, as shown in Figure 
14.17. Thus, an ideal lowpass filter would perfectly recover the signal, that is, 
y[»] =x\n\. 

The frequency response of the ideal lowpass filter with cutoff frequency co c 
depicted in Figure 14.18 is simply given by 




JO)\_ 


| co - k2n\ < co c , k = . . .,-1,0,1,. . . 
otherwise 


(14.26) 


Its impulse response (from Table D.7 in Appendix D) is noncausal, real, and 
even: 


sm<y n co 

h [«] = — = — smc 

p nn n 


' 00 n \ 


V n ) 


(14.27) 
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FIGURE 14.17 Fourier transforms of signals in filtering problem. 
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FIGURE 14.18 Frequency response of an 
ideal discrete-time lowpass filter. 


which unfortunately makes a real-time implementation of this filter impossible. 


First-Order Approximation 

We have seen that the frequency response magnitude of a normalized causal, sta- 
ble, first-order filter is given by 


H(e JC0 ) 


(i-o) 


1 

1 -ae- ja 


1 — a 

(1 + a 2 - 2flcosw) 1/2 


( 14 . 28 ) 
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Suppose the cutoff frequency co c (bandwidth) of the filter is defined as the fre- 
quency where the magnitude is -3 dB. Then, we can find an expression for the real 
pole 0 < a < 1 in terms of the cutoff frequency co c . 


-3 dB = 201og l( 


10 


1 — a 

(1 + n 2 -2acos(O c ) h 
1 — a 


(1 + a -2acosco c ) 


1/2 


10" 10 (1 + a 2 - 2a cos co c ) = (1 - a) 2 


3 


-10 10 (l + n 2 -2acos(O c ) = -l + 2a-a 2 

_ 3 _ 3 _ 3 

(1 - 10 _T ° )fl 2 + (2 • 10 _l ° cos C0 c - 2)a + 1 - 10 _l ° = 0 

0.4988a 2 - (2 - 1 .0024 cos (O c )ci + 0.4988 = 0 ( 14.29) 

This quadratic equation can be solved for the pole 


a = ■ 


(2-1.0024cosw f ) + 1 1(2-1 .0024 cos (O c ) 2 
0.9976 ~2 V 

(2- 1.0024 cos co c ) 1 


0.2488 


-4 


0.9976 


0.9976 


(2- 1.0024 cos cu,) 2 - 0.9952 (14.30) 


Note that the plus sign leads to a pole larger than one; hence we select 
(2 -1.0024 cos (O ) 1 


a = 


0.9976 


0.9976 


^(2 -1. 0024 cos m) 2 -0.9952. (14.31) 


The poles corresponding to different cutoff frequencies as given by Equation 
14.31 are listed in Table 14.1. 


TABLE 14.1 Pole of First-Order Lowpass Filter vs. Cutoff Frequency 


(A 

n 

n 

3 K 

71 

5 n 

3 n 

W C 

T6 

8 

T6 

4 


~8~ 

a 

0.821841 

0.677952 

0.563235 

0.472582 

0.401309 

0.3454 
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Example 14.1: For the cutoff frequencies ^ and the poles are 0 = 0.821841 

and a = 0.472582, respectively. The magnitudes of the first-order filters with these 
poles are plotted over the ideal brickwall magnitudes in Figure 14.19. We can see 
from this figure that a first-order filter is a very crude approximation to an ideal 
lowpass filter. 



FIGURE 14.19 Frequency response magnitudes of first-order 
discrete-time lowpass filters. 


Second-Order Approximation 

The frequency response magnitude of a normalized causal, stable, second-order 
filter with complex poles and two zeros at z = 0 was computed as 

1 + r 2 -2?-cos0 

T T- (14.32) 

[^1 + r 2 — 2r cos(ry + 0) J 2 1^1 + ?- 2 -2?-cos(a>-0)J 2 

Flere, we have two parameters to shape the frequency response, namely r and 
6. Without getting into specific optimal design techniques, we could see by trial 
and error using a software package such as MATLAB that it is possible to get a bet- 
ter approximation to an ideal lowpass filter using a second-order filter. For exam- 
ple, the magnitude of a second-order lowpass filter with co c = j rad is plotted over 
that of a first-order filter with the same cutoff in Figure 14.20. An easy improve- 
ment to the second-order lowpass filter would be to move one of its two zeros to z 
= -1, forcing the magnitude down to zero at (O c = ±jt. 
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FIGURE 14.20 Frequency response magnitudes of second-order and first-order 
discrete-time lowpass filters. 


Ideal Highpass Filter 

An ideal highpass filter with cutoff frequency (O c is given by 


H hp (e J “’) = 


1 , \a>-(2k + l)n\<n-(O c ,k<E'L 

0, otherwise 


This highpass frequency response is shown in Figure 14.21. 



FIGURE 14.21 Frequency response of an ideal 
discrete-time highpass filter. 
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The ideal highpass frequency response can be seen as the ideal lowpass spec- 
trum with cutoff frequency n - co c and frequency-shifted by n radians. From the 
frequency shifting property of the DTFT, we find that the impulse response of the 
ideal highpass filter is: 


h kp \n\ = e^h lp \n\ 

= ( _ 1 y, sin(;r - co c )n 


= (-D" 


nn 
sin (D c n 
nn 


(14.34) 


Unfortunately, this highpass filter is also impossible to implement in real time, 
as it is noncausal and the impulse response extends to infinity both toward the neg- 
ative times and the positive times. 


First-Order Approximation 

The ideal highpass frequency response can be approximated by a normalized 
causal, stable, first-order filter with a negative pole -1 < a < 0. The normalization 
is done at the highest frequency co - n; that is, z = -1 so that H(— 1) = 1 . 


H{z) = (\ + a) 

1 -az 

(14.35) 

\meH= 2 1+0 

(1 + a 2 -lacoseo)' 

(14.36) 


Note that the relationship between the cutoff frequency (O c and the pole a is 
given by Equationl4.31, but using the “new” pole |a| and the “new” cutoff fre- 
quency 7t - (O c . After | a | is obtained from the equation, the pole of the highpass fil- 
ter is just a = -|a|. 

37T 15 K 

Example 14.2: The poles corresponding to the cutoff frequencies and of 

a first-order highpass filter are a = -0.472582 and a = -0.821841, respectively. The 
corresponding filter magnitudes are plotted in Figure 14.22 over the ideal brickwall 
highpass frequency responses. 
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FIGURE 14.22 Frequency response magnitudes of first-order discrete-time 
highpass filters. 


Second-Order Approximation 

The frequency response of a normalized (atz = -1) causal, stable, second-order fil- 
ter with two zeros at 0 is given by 

1 + r 2 +2?-cos0 

= l f (14.37) 

j^l + r 2 -2 ?-cos(cd + 0)J 2 |^l + r 2 -2?-cos(ft>-0)J 2 

n 

Here, we restrict the poles to be in the left half of the unit disk; that is, 2 < 0< n. 
Example 14.3: Let us compare a second-order highpass filter, designed by trial 

3 71 

and error to get (Q c = — , with a first-order filter with the same cutoff frequency, as 
shown in Figure 14.23. The complex poles’ magnitude and angles obtained were 
r = 0.6, G = ±57t/6. Clearly, the second-order filter offers a better approximation 
to the ideal highpass filter than the first-order filter. 
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-0.2 -I 

FIGURE 14.23 Frequency response magnitudes of first-order discrete-time 
highpass filters. 


Ideal Bandpass Filter 

As shown in Figure 14.24, an ideal bandpass filter with a passband between 0) cl , 
co c2 has a frequency response given by 


1 , 

H bp (e im )=\, 

0 , 




FIGURE 14.24 Frequency response of an ideal 
discrete-time bandpass filter. 
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Second-Order Approximation 

The second-order frequency response is normalized at the frequencies ±co p where 
the peaks occur. These frequencies are found to be: 


co =±arccos< 

p 


I + r 2 
27- 


cos 0 


(14.39) 


Thus, the normalized magnitude of the second-order frequency response is 


H{e J( °) = 


l 

1 + r 2 -2rcos(CO ;i +9) 2 1 + /- 2 -2rcos((O p -0) 

i i 

[j + r 2 -2rcos(co + 0)] 2 ^1 + r 2 -2rcos(co-0)] 2 


(14.40) 


We can use this expression to carry out a design by trial and error. Suppose we 
are given the frequencies 0 ) cl , (O c2 of the ideal bandpass filter that we have to ap- 
proximate with a second-order filter. We first set co p = ' 2 rl , and we compute the 

pole angle 6 by using the inverse of the relationship in Equation 14.39: 

a 2r 

cosd = -cos co 

1 + r 2 p 


0 = arccos 



cosw 

p 


(14.41) 


Then, we can try out different values of 0 < r < 1 to obtain the proper passband. 

Example 14.4: Let us design a second-order bandpass filter approximating the 

ideal bandpass frequency response with 0 ) r] = co cl = f . We compute co p = = 

8 = 1.1781. Table 14.2 shows the pole angle for different values of r. 


TABLE 14.2 Magnitude and Angle of Complex Pole for the Design of a Second-Order 
Bandpass Filter. 


r 

0.6 

0.7 

0.8 

0.9 

9 

1.226366 

1.202992 

1.18818 

1.180386 
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The magnitude plot in Figure 14.25 shows that a (more or less) reasonable ap- 
proximation is obtained with r = 0.7, 8 = 1.203. 
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FIGURE 14.25 Frequency response magnitudes of second-order 
bandpass filters. 

((Lecture 5 6 :IIR and FIR Filters)) 


INFINITE IMPULSE RESPONSE AND FINITE IMPULSE 
RESPONSE FILTERS 


There exist two broad classes of discrete-time filters: infinite impulse response 
(IIR) filters and finite impulse response (FIR) filters. This section introduces both 
classes of filters and gives some basic analysis and design strategies for each. 

IIR Filters 

IIR filters have impulse responses extending to n — > oo . This includes the class of 
DLTI recursive filters, that is, filters represented by difference equations including 
delayed versions of the output y[«], Consider the general TV^-ordcr difference equa- 
tion of a stable, causal system with a Q ^ 0 : 

a 0 y[n\ + a { y[n -!] + ••■ + a N y[n - N] = b Q x[n] + b { x[n -!] + ••• + b M x[n - M], ( 14.42) 
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• r *1 

This equation represents an HR filter if at least one of the coefficients |a ( . j 
is nonzero. In terms of transfer functions, HR filters have transfer functions with at 
least one pole p m different from 0: 

( b +b z~ l H \-b z~ M ) 

H{z)= 1 ^ 

( a 0 + a { z +--- + a N z ) 

n La-^- 1 ) 

n M (z-z ) 

= Az n ~ m k —. (14.43) 

U>-p k ) 

The usual first-order and second-order filters are examples of HR filters, for 
example, 


1 "I Z | 

H(z) = f , |z|>-, (14.44) 

1--Z- 1 2 

2 

whose associated recursive difference equation is 

j[ w ] = v[«-1] + x[h] + ^x[h-1]. (14.45) 

We have already studied simple design methods for these types of filters (with 
their zeros restricted to be at 0) to approximate ideal filters in the previous section. 
There exist several approaches to design accurate high-order HR filters. One of 
them is to design the filter in continuous time (in the Laplace domain), using, for 
example, the Butterworth, Chebyshev, or elliptic pole patterns and then transform- 
ing the Laplace-domain transfer function into the z-domain using the bilinear trans- 
formation. Other computer-aided techniques use iterative optimization methods 
on the discrete-time filter coefficients to minimize the error between the desired 
frequency response and the filter’s actual frequency response. 

Benefits of IIR filters include the following: 

■ Low-order filters can offer relatively shaip transition bands. 

■ They have low memory requirements when implemented as a recursive equation. 
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One disadvantage of IIR filters is that a frequency response with an approxi- 
mately linear phase is difficult to obtain. A linear phase, corresponding to a time 
delay, is important in communication systems in order to avoid signal distortion 
caused by signal harmonics being subjected to different delays. 

FIR Filters 

FIR filters have, as the name implies, impulse responses of finite duration. For 
instance, causal FIR filters are non-recursive DLTI filters in the sense that their 
corresponding difference equations in the regular form have only a () y[n\ on the left- 
hand side: 


a Q y[n\ = b Q x[n \ + b x x[n - 1] H — + b M x[n - M], ( 14.46) 

Even though this difference equation is O th -order according to our original de- 
finition, as an FIR filter the system is said to be M ,h - order. Moving-average filters 
are of the FIR type. The impulse response of a causal FIR filter (with a 0 = 1 with- 
out loss of generality) is simply 

h[n\ = b 0 S[n] + bfi)[n - 1] H F b M S[n - M\. (14.47) 


That is, 


h[n] = 


\b n , n = 0,...,M 
[0, otherwise 


The transfer function of a causal FIR filter is given by 


(14.48) 


H(z) = b 0 +b l z~ l + »- + b M z~ 


b n z M + b.z M ~ 1 -\ \-b M 

0 1 M 


= A 




(14.49) 


Note that all the poles are atz = 0. Thus, only the zeros’ locations in the z-plane 
will determine the filter’s frequency response. A realization of a second-order 
causal FIR filter with unit delays is shown in Figure 14.26. 
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FIGURE 14.26 Realization of a second-order 
causal FIR filter. 


Moving-Average Filters 

A special type of FIR filter is the causal moving-average filter, whose coefficients 
are all equal to a constant (chosen so that the DC gain is 1); that is, the impulse re- 
sponse is a rectangular pulse: 


h[n ] = 


1 


M + 1 
0, otherwise 


n = 0,...,M 


This impulse response is shown in Figure 14.27 for M= 4. 


(14.50) 
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FIGURE 14.27 Impulse response of 
fourth-order moving average filter. 


The moving average filter is often used to smooth economic data in order to 
find the underlying trend of a variable. Its transfer function is 
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M + V > 


, M , M - 1 , , , 

1 Z +Z H hi 


M + 1 


(14.51) 


The frequency response of the causal moving average filter is computed as 
follows. 


H(e ]m ) 


= — (1 
M + l v 


+ e- jm + icoM 


1 . M ( . M . M ,, 

e 1 e 1 +e 1 H he 

M + l 


. ,M ,, .AT 

— l) -y®— 


M + l 


M + l 


1 + 2 ^ cos co( &) , Mi 

t-n 2 . 


. M (M— 1)/2 

V 


^ cos co( k) , M odd 

t-n 2 


(14.52) 


Alternatively, we can use the finite geometric sum formula in Table B.2 (Ap- 
pendix B) to obtain a single equivalent expression for H(e jco )\ 


i M 

)_ m7T?' 


1 1 - e~ Jm 

M + l 1 — e~ 


,-jO)(M+ 1 ) 


M+l . M+l 


(M + l)e 


.CO .CO CO 

r J 2 e J 2 - e J 2 


M + l 


M + l 


. CO 
sm — 


(14.53) 


The magnitude of this frequency response displays M zeros, the first one being 

In 

at cn= yTTj, as shown in Figure 14.28. Thus, the bandwidth of this lowpass filter 
depends only on its length and cannot be specified otherwise. 
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FIGURE 14.28 Frequency response magnitudes of moving average FIR filters. 


Also, since there are M zeros in H(e ja> ), these zeros must be zeros of H(z) on 
the unit circle. Thus, the pole -zero plot of a moving average filter is as shown in 
Figure 14.29 (case M= 4.) 



FIGURE 14.29 Pole-zero plot of moving average FIR 
filter of order 4. 


The zeros are equally spaced on the unit circle as though there were M + 1 
zeros, with the one at z = 1 removed. 

((Lecture 57.FIR Filter Design by Windowing)) 
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FIR Filter Design by Impulse Response Truncation 

FIR filters can be designed via a straight truncation of a desired infinite impulse 
response. This method is very effective and popular because it is straightforward, 
and one can get extremely shaip transitions and linear phases, but at the cost of 
long filter lengths. 

Consider for example the noncausal, real, even, infinite impulse response of 
the ideal lowpass filter: 


co 


h [«] = — sine 


' CO n A 


n 


\ 71 J 


sin(<y,«) 


( 14 . 54 ) 


Tin 


This impulse response is plotted in Figure 14.30 for the cutoff frequency co c = 



FIGURE 14.30 Impulse response of ideal lowpass MR filter. 


A first attempt would be to truncate this response and keep only the first M + 
1 values of the causal part. However, this does not produce very good results. For 
a given filter length M + 1 and assuming that M is even, it is much better to time- 
delay the impulse response by Ml 2 first and then truncate it to retain only the val- 
ues for n = . 

Example 14.5: Suppose we select M = 40, and we want to have a cutoff fre- 

quency of co c = p Then, we delay the impulse response shown above by 20 time 
steps and truncate it to obtain the finite impulse response h[n] = h Ip [n - 20 ](w[«] - 
u[n - 41]) shown in Figure 14.31. 
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-5 0 5 10 15 20 25 30 35 40 45 


n 


FIGURE 14.31 Impulse response of a causal FIR filter 
obtained by truncation and time shifting of an ideal 
lowpass MR filter. 


The frequency response of this causal FIR filter can be obtained numerically 
from the following expression: 


H(e J(0 ) = h[ 0] + h[l\e~ Jm + ■ ■ ■ + h[4 OJe'^ 40 

( 19 '\ 


= e 


~J«> 20 


0.25 + 2^ h[k] cos[ftJ(20 -k)\ 


V 


k = 0 


J 


(14.55) 


Its magnitude is plotted in Figure 14.32 and is compared to the ideal lowpass 
filter with cutoff frequency (» c = 


1.2 - 

H(e im ) 

A . 

. A 



M / xi 

\j t 




j 0.8 - 




0.6 - 




0.4 - 
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0.2 - 
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tw,. .... 


- 3.14 - 2.355 - 1.57 - 0.785 0 0.785 1.57 2.355 3.14 

FIGURE 14.32 Frequency response magnitudes of causal FIR and ideal 
lowpass filters for M = 40 and C0 c = j. 
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The phase is piecewise linear and linear in the passband where 
ZH(e jm ) = -20ft) . 


Remarks: 

■ Longer finite impulse responses yield increasingly better filters. 

■ The causal FIR filter cquation yfu] = fi[Q]x[n] + h [ I ]x[n - 1] H 1- h[M]x[n - M\ 

is nothing but the discrete-time convolution sum. 

FIR Filter Design Using Windows 

A straight truncation of a desired infinite impulse response can be seen as the mul- 
tiplication in the time domain of a rectangular window w\n\ with the infinite im- 
pulse response of the filter. Then, the resulting finite impulse response centered at 
77 = 0 is time-delayed to make it causal. The resulting effect in the frequency do- 
main is the periodic convolution of the Fourier transforms of the infinite impulse 
response H lp (e J0> ) and of the rectangular window W(e J(0 ). 

Example 14.6: Suppose we select M = 20. The even rectangular window 

w\n\ = u\n + \Qi\-u\n-\\\ (14.56) 

is applied to the impulse response h lp [n\ of the ideal lowpass filter with cutoff fre- 
quency co c = 2 in order to truncate it. The impulse response of the FIR filter before 
the time shift is given by 

h 0 [n\ = w[n]h lp [n\. (14.57) 

Its corresponding frequency response is the convolution of the spectra of the 
rectangular window and the ideal lowpass filter: 

H 0 (e Ja ) = — J W(e JV )H lp (e j(0l - V) )dv. (14.58) 

—n 

This convolution operation in the frequency domain is illustrated in Figure 
14.33. 

The subsequent time shift h[n] = h (i [n — 1 0] only adds a linear negative phase 
component to H 0 (e jco ), but it does not change its magnitude. The magnitude of 
H(e jco ) is shown in Figure 14.34. 

The truncation method can be improved upon by using windows of different 
shapes that have “better” spectra. Note that the best window would be the infinite 
rectangular window, since its DTFT is an impulse at ft) = 0. Then the convolution 
of W(e J0> ) = 8(co ) with the rectangular spectrum of the lowpass filter would leave it 
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FIGURE 14.33 Convolution of the frequency response of an ideal lowpass filter with the 
DTFT of a rectangular window. 



FIGURE 14.34 Frequency response magnitudes of causal 
FIR and ideal lowpass filters for M = 20 and (O c = 


unchanged. This limit case helps us understand that the Fourier transform of a 
good window should have as narrow a main lobe as possible and very small side 
lobes. Essentially, the narrower the main lobe is, the sharper the transition will be 
around the cutoff frequency. Large side lobes in W(e J0> ) lead to larger ripples in the 
passband and stopband of the filter. 
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In general, there is a tradeoff in selecting an appropriate window: For a fixed 
order M, windows with a narrow main lobe have larger side lobes, and windows 
with smaller side lobes have wider main lobes. 

This tradeoff led researchers to propose different windows such as the Han- 
ning, Hamming, Bartlett, Blackman window, etc. Note that as the window length 
M+ 1 gets longer, the main lobe gets narrower, leading to a sharper transition, but 
the maximum magnitude of the side lobes does not decrease. The even Hamming 
window with M even, shown in Figure 14.35, is defined as follows: 


( 2 Kn^ 

w[n]= 0.54 +0.46 cos 

M 


(u[n + M/2] -u[n- M/2-1]). (14.59) 



FIGURE 14.35 Hamming window for M = 20. 


The Fourier transform of the Hamming window has smaller side lobes but a 
slightly wider main lobe than the rectangular window, as can be seen in Figure 14.36. 



FIGURE 14.36 DTFT of a Hamming window for M = 20. 
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K 

For the same lowpass FIR filter design as above, namely M= 20 and (O c = y, 
but this time using the Hamming window instead of the rectangular window, we 
obtain the finite impulse response of Figure 14.37. 


/?[«] 



FIGURE 14.37 Impulse response of a causal FIR 
filter obtained by windowing and time shifting of an 
ideal lowpass MR filter, using a Hamming window 
with M = 20. 


The magnitude of the filter’s frequency response is shown in Figure 14.38. We 
can see that the passband and stopband are essentially flat, but the transition band 
is wider than the previous design done by truncation. 



FIGURE 14.38 Magnitudes of causal FIR and ideal lowpass 
filters for M = 20 and CO c = designed using a Hamming 
window. 
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Linear Phase Condition 

A causal FIR filter of order M has a linear phase if and only if its impulse response 
satisfies the following condition: 


h[n] = h[M-n\. (14.60) 

This simply means that the filter is symmetric around its middle point. For a 
filter h 0 [n] centered at n = 0 (before it is time-shifted to make it causal), the linear 
phase condition becomes the zero-phase condition, and it holds if /? 0 [«] is even. 

It turns out that only FIR, not IIR, filters can have a linear phase. The fre- 
quency response of a linear phase FIR filter is given by 


H(e Ja ) = h[ 0] + h[l]e~ J(0 + ■ ■ ■ + h[M]e~ jwM 

. M ( M/2-1 


h[M/ 2] + 2 ^ h[k]cos[co(M /2- k)] 

k = 0 

(M— 1)/2 

2 ^ h[k]cos[a>(M/2- k)] 


_ ja M ( )/2 


M even 


V k = 0 


M odd 


(14.61) 


SUMMARY 


In this chapter, we analyzed the behavior of DLTI systems in both the time and fre- 
quency domains. 

■ The frequency response can be characterized in a qualitative fashion just by 
looking at the pole-zero plot. The frequency, impulse, and step responses of 
first-order and second-order systems were analyzed. 

■ Ideal frequency-selective discrete-time filters were discussed, and first and 
second-order approximations were given. 

■ Discrete-time IIR and FIR filters were introduced, and the windowing tech- 
nique for FIR filter design was presented. 


TO PROBE FURTHER 


For comprehensive treatments of discrete-time systems and filter design, see Op- 
penheim, Schafer and Buck, 1999; Proakis and Manolakis, 1995; and Winder, 
2002 . 
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EXERCISES 

Exercises with Solutions 

Exercise 14.1 

(a) Design a discrete-time second-order IIR bandpass filter approximating the 

71 3k 

ideal bandpass filter with frequencies © cl = 4 , C0 c2 = 4 and normalize it 
to have a passband-frequency gain of 1 . 


Answer: 

We compute 0) ,, - 7 = 2 . The pole angle is independent of r, as 


2 r 


6 = arccos*! _ cos to !> = arccosiO j = — . 

U + r pt 1 J " 


The transfer function is 

1 

|^l + r 2 -2rcos(co p + 0)J 2 |^l + r 2 -2rcos(co p -0)J 


H(z)='- 


l-2rcos0z 1 +r 2 z 2 


z > r 


z > r 


j^l + r 2 -2rcos(7r)] 2 j^l + r 2 -2rcos(0)J 

. _ 7T _i 9 — 2 

1 — 2rcos — z +r z 
2 

[l + r 2 + 2r] 2 [l + r 2 -2r] 2 [(l + r 2 ) 2 -4r 2 J (l-r 2 ) 2 


1 , 2-2 

l + r z 


1 , 2-2 

l + r z 


1 , 2-2 

l + r z 


z >r. 


The magnitude plot in Figure 14.39 shows that a “reasonable” design is ob- 
tained with r = 0.52. 

(b) Plot the magnitude of its frequency response and the magnitude of the 
ideal bandpass filter on the same graph. 


Answer: 

The frequency response magnitudes of the bandpass filters are plotted in Figure 
14.39. 
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//U ' !.//•>• ' ! 



4 4 4 4 


FIGURE 14.39 Magnitudes of second-order MR and ideal 
bandpass filters (Exercise 14.1). 


Exercise 14.2 

(a) First, design a lowpass FIR filter of length M + 1 = 17 with cutoff fre- 
quency (O c = ~ A using a Flamming window. Plot its magnitude over the 
magnitude of the ideal filter. 
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Frequency response: 


H(e jm ) = h[ 0] + h[l\e- jw + • ■ ■ + h[l6]e~ j(o16 

( 7 A 


= e 


-i»> 8 


/?[8] + 2^/7[k]cos(cu(8 - k )) 


J 


= e 


-j(0S 


- + 2 X- 

4 ^ 


K 


7 sin -(k- 8) r 


n(k-%) 


0.54 + 0.46 cos 


2n(k-%) 

16 


cos(cn(8-A:)) 


The magnitude of this frequency response, which is just the absolute value of 
the big bracket in the last line of the above equation, is plotted in Figure 14.40. 
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FIGURE 14.40 Magnitudes of 1 6th-order Hamming- 
windowed FIR and ideal lowpass filters (Exercise 14.2). 





















/ 

/ 

\ 

\ 

\ 










/ 

/ 

'T 

\ 









i 

1 

t 






/ 

1 

■1 

l_ 



\ 






y: 
/ : 

/ 1 
y i 




\ 

\ 





ON THE CD 


The following MATLAB M-file used to design the FIR filter can be found on 
the companion CD-ROM in D:\Chapterl4\FIRdesign.m. 
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%% Freq resp of FIR filter 

% number of points in FIR filter is M+1 

M=16; 

% cutoff frequency of lowpass 
wc=pi/4; 

% freq vector 
w=[ - pi : 0 . 01 :pi] ’ ; 

% FR computation using cosine formula 
Hj w=(wc/pi)*ones(length(w) , 1 ) ; 
for k=0 : M/2 - 1 

H j w=H j w+2*sin ( ( k-M/2) *wc) /((k-M/2)*pi)*(0. 54+0 . 46*COS(2*pi*(k- 

M/2)/M) )*cos(w*(M/2-k) ) ; 

end 

% Ideal lowpass 
Hlp=zeros(length(w) ,1 ) ; 
for k=1 : length (w) 
if (abs(w(k) ) < wc) 

Hip ( k ) =1 ; 

end 

end 

%plot frequency response 
plot (w, abs (Hjw) ,w,Hlp) ; 

(b) Use the filter in (a) to form a real bandpass FIR filter with cutoff frequen- 

K ?>K 

cies 4 ^. Give its impulse response and plot its magnitude over the mag- 
nitude of the ideal bandpass filter and that of the HR filter in Exercise 14. 1 . 


Answer: 

Using frequency shifting, 

7T .. n . 

l(CO+— ) l((0 — ) 

H l (e ]a ) = H(e 2 ) + H(e 2 ) 

{ -/(©+—) -j(CD+—) 16 1 I — 16 I 

h[0] + h[l]e 2 + — + h[16]e 2 > + lh[0] + h[l]e 2 + — + h[16]e 2 > 

16 -—h —k 

= 2/z[0]+^(e"'' 2 + e 2 )h[k]e~ ika 

k = 1 

16 7 T 

= 2h[0] + Y J 2cos(-k)h[k]e~ ikl ° . 

k= 1 2 



536 Fundamentals of Signals and Systems 


The impulse response is given by h t [k] = 2cos (^k)h[k]; thus, 


H l (e ia ) = e- iaS 


/?,[8] + 2^/!j[A:]cos(g)(8 - k )) 


-ja> 8 
= e 


^ + 2^2cos (^k)- 


sin —(k— 8) r 


n(k- 8) 


0.54 + 0.46 cos 


( 2n(k-%) 


\ 16 


COS (ft)(8 — k)) 


The frequency response magnitudes of this FIR bandpass filter and of the sec- 
ond-order IIR filters of Exercise 14.1 are shown in Figure 14.41. 
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FIGURE 14.41 Magnitudes of bandpass filters (Exercise 14.2). 


(c) Give an expression for the phase in the passband of the FIR bandpass filter. 
Answer: 

The phase in the passband is -8cu. 

Exercises 

Exercise 14.3 

Consider the following moving-average filter S initially at rest: 
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S: y\n\ = — x[n + 1] H — x\n\-\ — x[n- 1] H — x[n- 2] . 

4 4 4 4 

( a) Find the impulse response h[n] of the filter. Is it causal? 

(b) Find the transfer function of the filter H(z) and give its region of conver- 
gence. Sketch the pole-zero plot. 

(c) Find the frequency response of the filter. Sketch its magnitude. 

(d) Compute the -3 dB cutoff frequency co c . 


Answer: 
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Exercise 14.4 

Suppose we want to design a causal, stable, first-order highpass filter of the type 

H(z) = — , Z > <2 

1-az 

2 ji 

with -3 dB cutoff frequency C 0 c = 3 and a real. 

(a) Express the real constant B in terms of the pole a to obtain unity gain at the 
highest frequency co = n. 

(b) Design the filter; that is, find the numerical values of the pole a and the 
constant B. 

(c) Sketch the magnitude of the filter’s frequency response. 

Exercise 14.5 

(a) Design a discrete-time second-order HR lowpass filter approximating the 

K 

ideal lowpass filter with -3 dB cutoff frequency C 0 c = ^ and normalize it 
to have a DC gain of 1 . You can proceed by trial and error. Plot the mag- 
nitude of its frequency response (use MATLAB) and the magnitude of the 
ideal lowpass filter on the same figure. 

(b) Add a zero at co = n to your design to improve the response at high fre- 
quency. Plot the resulting frequency response magnitude as well as the re- 
sponse in (a) and discuss the results. 


Answer: 
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Exercise 14.6 

(a) First, design a lowpass FIR filter of order M= 256 with cutoff frequency 

7T 

CQ c = g radians using a Hamming window. Plot its magnitude over the 
magnitudes of the ideal filter and the filters in Exercise 14.5. 

(b) Give an expression for the phase in the passband of the FIR bandpass filter. 

(c) Simulate the filter for the input x[n\ = cos( * n)u\ n ] + cos( * n)u\ n \ until the 
output reaches steady-state and plot the results. Also plot the input on a 
separate graph. 

Exercise 14.7 

(a) Design a first-order discrete-time lowpass filter with a -3 dB cutoff Ire- 

K 

quency C0 c = yy and a DC gain of 1 . 

(b) Plot the magnitude of its frequency response. 

(c) Write the filter as a difference equation and plot the first 20 values of the 
filtered signal y\n\ for the input signal x[n] = u[n]-u[n- 10] with the 
filter being initially at rest. 


Answer: 
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Exercise 14.8 

(a) Design a DT second-order HR bandpass filter approximating the ideal 

bandpass filter with frequencies © cl = > ® C 2 = v and normalize it to 

have a passband-frequency gain of 5. 

(b) Plot the magnitude of its frequency response and the magnitude of the 
ideal bandpass filter on the same figure. 

Exercise 14.9 

(a) Design a first-order DT lowpass filter with a -3 dB cutoff frequency 

K 

(O c = and a DC gain of 1 . 

(b) Plot the magnitude of its frequency response. 

(c) Write the filter as a difference equation, and plot the first 1 5 values of the 
filtered signal y[n] for the input signal x[n\ = u[n - 2 ] . 
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Answer: 
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Exercise 14.10 

(a) Design a 20th-order (i.e., M = 20) DT causal FIR highpass filter approxi- 

2 TZ 

mating the ideal highpass filter with co c = — and normalized to have a 
high-frequency gain of 1 . Use the straight truncation (rectangular window) 
technique. 

(b) Repeat (a) using the Hamming window. 

(c) Plot the magnitudes of the frequency responses of the two FIR filters, the 
magnitude of the IIR filter obtained in Exercise 14.4, and the magnitude of 
the ideal highpass filter on the same figure. 

(d) Plot the first 20 values of the two filtered signals y[n\, i.e., the output of 
each filter, for the step input signal x[n] = u[n\. 
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In This Chapter 

■ Sampling of Continuous-Time Signals 
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■ Discrete-Time Processing of Continuous-Time Signals 

■ Sampling of Discrete-Time Signals 

■ Summary 

■ To Probe Further 

■ Exercises 



((Lecture 58: Sampling)) 


T his chapter introduces the important bridge between continuous-time and 
discrete-time signals provided by the sampling process. Sampling records 
discrete values of a continuous-time signal at periodic instants of time, either 
for real-time processing or for storage and subsequent off-line processing. Sam- 
pling opens up a world of possibilities for the processing of continuous-time sig- 
nals through the use of discrete-time systems such as infinite impulse response 
(IIR) and finite impulse response (FIR) filters. 
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SAMPLING OF CONTINUOUS-TIME SIGNALS 

Recall that the Fourier transform of the continuous-time signal x(t) is given by 

+oo 

X(jco) = J x(t)e- Jm, dt. (15.1) 

Under certain conditions, a continuous-time signal can be completely repre- 
sented by (and recovered from) its samples taken at periodic instants of time. The 
sampling operation can be seen as the multiplication of a continuous-time signal 
with a periodic impulse train of period T s , as depicted in Figure 15.1. The spectrum 
of the sampled signal is the convolution of the Fourier transform of the signal with 
the spectrum of the impulse train, which is itself a frequency-domain impulse train 
of period equal to the sampling frequency CO s =2 n/T s . This frequency-domain 
analysis of sampling is illustrated in Figure 15.2. 



FIGURE 15.1 Impulse train sampling of a continuous-time signal. 



FIGURE 15.2 Frequency domain representation of impulse train sampling of a 
continuous-time signal. 
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The resulting sampled signal in the time domain is a sequence of impulses 
given by 


x s (t) = X x(nT s )S(t - nT s ), (15.2) 

tl — — OO 

where the impulse at time t = nT s has an area equal to the signal value at that time. 
In the frequency domain, the spectrum of the sampled signal is a supeiposition of 
frequency-shifted replicas of the original signal spectrum, scaled by 1 JT S . 

i +~ +=» 

X s (jco) = — \x{jv)^8{(0-v-k(0 s )dv 

*s *=—> 

i 7 7 ; 

= — I 2^ X(j (co - kco s ))8(co -v- kco s )dv 
= ^ F J J X(j((0-k(0 s )) (15.3) 


The Sampling Theorem 

The extremely useful sampling theorem, also known as the Nyquist theorem, or the 
Shannon theorem, gives a sufficient condition to recover a continuous-time signal 
from its samples x(nT s ), neZ. 

Sampling theorem: Letx(t) be a band-limited signal with X(ja>) = 0 for |<a| > co M . 
Then x(t) is uniquely determined by its samples x(nT s ), - °° < n < +«> if 

(O s > 2(O m , (15.4) 

2 71 

where co s = f - is the sampling frequency. 

Figure 15.2 suggests that given the signal samples, we can recover the signal 
x(t) by filtering x s (t) using an ideal lowpass filter with DC gain T s and with a cut- 
off frequency between co M and co s - co M , usually chosen as “ , which is called the 
Nyquist frequency. It is indeed the case, and the setup to recover the signal is shown 
in Figure 15.3. 

The sampling theorem expresses a fact that is easy to observe from the exam- 
ple plot of Xfjcd) in Figure 15.2: the original spectrum centered at 0 ) = 0 can be 
recovered undistorted provided it does not overlap with its neighboring replicas. 
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a> c ~ a> l j 2 


x(t) 

— ► 


FIGURE 15.3 Ideal lowpass filter used 
to recover the continuous-time signal 
from the impulse train sampled signal. 


Sampling Using a Sample-and-Hold Operator 

The sample-and-hold (SH) operator retains the value of the signal sample up until 
the following sampling instant. It basically produces a “staircase” signal, that is, a 
piecewise constant signal from the samples. A schematic of an ideal circuit imple- 
menting a sample-and-hold is shown in Figure 15.4. The switch, which is assumed 
to close only for an infinitesimal period of time at the sampling instants to charge the 
capacitor to its new voltage, is typically implemented using a field effect transistor. 


v ,„(0 



-0 >’(0 


c -I- 


FIGURE 15.4 Simplified sample-and-hold circuit. 


The theoretical representation of a sample-and-hold shown in Figure 15.5 
consists of a sampling operation (multiplication by an impulse train), followed by 
filtering with a linear time-invariant (LTI) system of impulse response h 0 (t), which 
is a unit pulse of duration equal to the sampling period T s . Note that the sample- 
and-hold operator is sometimes called zero-order-hold (ZOH), although here 
we call zero-order-hold only the LTI system block with impulse response h 0 (t) in 
Figure 15.5. 

Example 15.1: The continuous-time signal x(t) shown in Figure 15.6 is sam- 
pled using a sample-and-hold operator, resulting in the continuous-time piecewise 
constant signal x 0 (t). 
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FIGURE 15.5 Sample-and-hold operator. 



FIGURE 15.6 Effect of sample-and-hold operator on an input signal. 


Note that the sampled signal x 0 (t) carries the same information as the samples 
themselves, so according to the sampling theorem, we should be able to recover the 
entire signal x(t). It is indeed the case. From the block diagram of the sample-and- 
hold, what we would need to do is find the inverse of the ZOH system with impulse 
response h 0 (t) and then use a perfect lowpass filter. The frequency response Hfijco) 

is given by the usual sine function for an even rectangular pulse signal, multiplied 
_ ■ T 

by e Jl ° 2 * * because of the time delay of TJ2 seconds to make the pulse causal: 


2 sine =2e 

, Ik 


-jofe sin(w’f) 


The inverse of H 0 ( jco) is given by 

H l (jco)=H-\jeo) = ^e ja,: 2 . W . (15.6) 

2 sm(<y 2 S ) 

The reconstruction filter is the cascade of the inverse filter and the lowpass filter, 


H r (j(o)-.= T s H lp U(o)Hfijco\ 
whose magnitude and phase are sketched in Figure 15.8. 


(15.7) 
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FIGURE 15.7 Signal reconstruction from the output of the sample-and-hold. 


* \Hxm\ 


O). 


2 



FIGURE 15.8 Frequency 



Unfortunately, this frequency response cannot be realized exactly in practice, 
one of the difficulties being that its phase reflects a time advance of TJ2 seconds, 
but it can be approximated with a causal filter. In fact, in many practical situations, 
it is often sufficient to use a simple (nonideal) lowpass filter with a relatively flat 
magnitude in the passband to recover a good approximation of the signal. For ex- 
ample, many audio systems have a ZOH at the output of each channel and rely on 
the natural lowpass frequency responses of the loudspeakers and the human ear to 
smooth the signal. 



((Lecture 59: Signal Reconstruction and Aliasing)) 


SIGNAL RECONSTRUCTION 


Assume that a band-limited signal is sampled at the frequency °L = T that satis- 
fies the condition of the sampling theorem. What we have as a result is basically 
a discrete-time signal x(nT s ) from which we would like to recover the original 
continuous-time signal. 
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Perfect Signal Interpolation Using Sine Functions 

As seen above, the ideal scenario to reconstruct the signal would be to construct a 
train of impulses x s (t) from the samples and then to filter this signal with an ideal 
lowpass filter. In the time domain, this is equivalent to interpolating the samples 
using time-shifted sine functions with zeros at nT s for C 0 c = d) J 2 as shown in Fig- 
ure 15.9. Each impulse in x s (t) triggers the impulse response of the lowpass filter 
(the sine signal), and the resulting signal x(t) at the output of the filter is the sum of 
all of these time-shifted sine signals with amplitudes equal to the samples x(nT s ). 

+oo rji 

x(t) = ^ x(nT s ) sinc( — — ) (15.8) 

fc=-~ T s 

This is clearly unfeasible, at least in real time. However, there are a number of 
ways to reconstruct the signal by using different types of interpolators and recon- 
struction filters. 



Zero-Order Hold 

The ZOH, now viewed as an interpolator in Figure 15.10, offers a coarse way to re- 
construct the signal. It interpolates the signal samples with a constant line segment 
over a sampling period for each sample. Another way to look at it is to observe that 
the frequency response H 0 ( jco) is a (poor) approximation to the ideal lowpass fil- 
ter’s, as shown in Figure 15.11, where the spectrum of the signal x(t) is a triangle. 



548 


Fundamentals of Signals and Systems 



-*,(') 





^ T. 2 T. 371 4T, 


1 J 

| * t .O) 

T A 

-T s 

TTT> ; 

ZOh 

[ 



FIGURE 15.10 Signal interpolation using a ZOH. 



FIGURE 15.11 Spectrum of a signal interpolated using a ZOH. 


First-Order Hold (Linear Interpolation) 

The first-order hold (FOH) has a triangular impulse response instead of a rectan- 
gular pulse. The resulting interpolation is linear between each sample. It is closer 
to the signal than what a ZOH could achieve but it is noncausal. However, the FOH 
can be made causal by delaying its impulse response by T s seconds, although this 
also causes a delay T s between the original signal and its interpolated version. In the 
frequency domain, the Fourier transform of h t (t) is also a better approximation to 
the ideal lowpass filter than H 0 (jcd) is, essentially because the magnitude \H ] (j0))\ 
is the square of the sine function; that is, \H l (jco)\ = \H 0 (jco)\ , as shown in Figure 
15 . 12 . 
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FIGURE 15.12 Signal interpolated using an FOH. 


Aliasing 

When a sampling frequency is too low to avoid overlapping between the spectra, 
we say that there is aliasing. Aliasing occurs when sampling is performed at too 
low a frequency that violates the sampling theorem, that is, when (O s < 2 co m . Look- 
ing at Figure 15.13, we see that the high frequencies in the replicas of the original 
spectrum shifted to the left and to the right by 0 ) get mixed with lower frequen- 
cies in the original spectrum centered at 0. With aliasing creating distortion in the 
spectrum, the original signal cannot be recovered by lowpass filtering. 

The effect of aliasing can sometimes be observed on television, particularly in 
video footage of cars whose wheels appear to be slowing down when the car is in 
fact accelerating. The video frames have a frequency of 30 frames per second (30 
Hz), which is the standard video sampling rate. Aliasing can occur when the iden- 
tical wheel spokes repeat their geometrical pattern (e.g., with one spoke vertical) 
for example, 20 times per second. This could produce the impression that the wheel 
pattern is repeating 10 times a second (30-20 Hz), making the wheels appear to be 
spinning slower than the speed of the car would suggest. 
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FIGURE 15.13 Aliasing due to a low sampling frequency. 


Another classical way to illustrate aliasing is the sampling of a sinusoidal sig- 
nal at less than twice its fundamental frequency, as given in the following example. 

Example 15.2: Assume signal x(t) = cos(co 0 t) is sampled at the rate of 

co s = 1.5ft> 0 , violating the sampling theorem. Figure 15.14 shows the resulting 
effect of aliasing in the frequency domain, which brings two impulses at the fre- 
quencies ±co l = ±(co s — co g ) = ±0.5 co 0 . If the sampled signal were lowpass filtered 
with a prescribed cutoff frequency of (O c = 0.5co s and a gain of T s , then only those 
two impulses would remain at the output of the filter, corresponding to the signal 
Xj(f) = cos (co { t) = cos(0.5 (O 0 t). Figure 15. 15 shows that this sinusoidal signal of a 
fundamental frequency half that of the original sinusoidal signal also interpolates 
the samples. 
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FIGURE 15.14 Aliasing of a sinusoidal signal. 
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FIGURE 15.15 Aliasing effect: two sinusoidal signals 
of different frequencies interpolate the samples. 


Remarks: 

■ Most continuous-time signals in practical situations have a spectrum that is not 
band-limited, but instead tapers off to zero as the frequency goes to infinity. 
Sampling such signals will produce aliasing and therefore distort the base spec- 
trum of the sampled signal, centered around CO = 0 , with a resulting loss of in- 
formation. In order to avoid this situation, a continuous-time antialiasing filter 
must be used to band-limit the signal before sampling. An antialiasing filter is 
a lowpass filter whose cutoff frequency is set lower than half the sampling fre- 
quency. Though it will introduce some distortion at high frequencies in the 
original spectrum, it is often a better solution than introducing aliasing distor- 
tion at lower frequencies by not using an antialiasing filter. Comparing for ex- 
ample the spectrum of the sampled signal in Figure 15.16 with the aliased 
spectrum in Figure 15.13, we can see that the use of an antialiasing filter has 
significantly reduced the distortion. 

■ It is also possible to increase the sampling rate such that the spectrum of the 
signal has negligible energy past the Nyquist frequency (m/2). Care must be 
exercised though, since any noise energy present at frequencies higher than 
coJ2 will be aliased to low frequencies as well, generating distortion. Thus, this 
is typically not a good solution. 

■ In practice, a generally safe rule of thumb is to choose the sampling frequency 
to be five to ten times higher than the bandwidth of the signal. However, this 
choice may prove too conservative for some applications. 
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((Lecture 60: Discrete-Time Processing of Continuous-Time Signals )) 


DISCRETE-TIME PROCESSING OF CONTINUOUS-TIME SIGNALS 


Discrete-time processing of continuous-time signals has been made possible by the 
advent of the digital computer. With today’s fast, inexpensive microprocessors 
and dedicated digital signal processor chips, it is advantageous to implement 
sophisticated filters and controllers for continuous-time signals as discrete -time 
systems. 

We have reviewed all the mathematical machinery needed to analyze and de- 
sign these sampled-data systems. The fundamental result provided by the sam- 
pling theorem allows us to make the connection between continuous time and 
discrete time. Consider the block diagram of a sampled-data system in Figure 
15.17. The blocks labeled CT/DT and DT/CT are conversion operators described 
in the next section. 



T s T s 


FIGURE 15.17 Sampled-data system for discrete-time processing of continuous-time 
signals. 
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CT/DT Operator 

As indicated in Figure 15.17, the continuous-time to discrete-time operator CT/DT 
is simply defined by 

CT/DT: x d [n] = x(nT s ), tie Z. (15.9) 

It is also useful to think of the CT/DT operator as impulse train sampling fol- 
lowed by a conversion of the impulse areas to values of a discrete-time signal rep- 
resented by the operator V in Figure 15.18. To be fancy, operator V, which maps 
the set of impulse-sampled signals X s into the set of discrete-time signals X d , can 
be defined as follows: 


_ T. 
nT.-i — - 
2 


V:X, —>X. 


,[«]= J x s {t)dt. 


n e Z. 


(15.10) 


Note that the information is the same in both representations x s (t) and x d [n ] of 
the sampled signal, as suggested by Figure 15.19. 



v(0 = y S(t-nTj 
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FIGURE 15.18 CT/DT conversion operator. 
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FIGURE 15.19 Impulse train sampled signal and its discrete-time counterpart in the 
CT/DT operation. 
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The sampling period of T s seconds is normalized to 1 in the discrete-time sig- 
nal x d [n], For the remainder of this section, let the continuous-time frequency vari- 
able be denoted as CO, and the discrete-time frequency variable as LI. Recall that the 
spectrum X s (jco) of the sampled signal x s (t) is an infinite sum of replicas of X(jco) 
shifted at integer multiples of the sampling frequency co s = yr. Hence, X s (jcd) is 
periodic of period (O s . The discrete-time Fourier transform (DTFT) X (e JS1 ) of 
x d [n] is also periodic, but of period 27t. The relationship between the two spectra is 
then simply 


X d (e jil ) = XJjLl/TJ (15.11) 

ft) 

as we now show. 

+°° -poo 

X,(ja>)= j X x(nT s )S(t - nT s ]e jm 'dt 

_oo n=—»o 

= £ x(nT s )e- ],MT ‘ 

n=—oo 

= £ x d [n]e-*’ nT ‘ 

n=—oo 

= X x d [n}e~ filn for ® = 

n =- oo * s 

= X d (e jaT ’) (15.12) 

Thus, we have X s (jco) = X d (e J " >T ‘), or equivalently Equation 15.11. This im- 
portant result means that the shape of the spectrum of the discrete-time signal x d [n ] 
is the same as the shape of the spectrum of the sampled signal x s (0- The only dif- 
ference is that the former is compressed in frequency in such a way that the 
frequency range [-co/2, co/2] is mapped to the discrete-time frequency range 
[— 7t, 7t]. Figure 15.20 shows an example of a continuous-time signal with a trian- 
gular spectrum that is sampled and converted to a discrete-time signal with the 
CT/DT operator. 
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FIGURE 15.20 Frequency-domain view of sampled signal and its discrete-time 
counterpart in the CT/DT operation. 
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The last step in characterizing the CT/DT operator is to relate X d (e' u ) to 
X(jco). Recall that 


1 Too 

X,(ja>) = ~ S x U(o) - kco s )). 

1 n l no 


Thus, from Equation 15.1 1 we obtain 
X d (e ' a ) = X s (j Q/ T s ) 


1 +oo 

4i* 


^ ^ (Q-£2tt) a 


T.£ 


(15.13) 


(15.14) 


Remarks: 

■ An analog-to-digital (A/D) converter is the practical device used to imple- 
ment the ideal CT/DT operation. However, an A/D converter quantizes the sig- 
nal values with a finite number of bits, for example, a 12-bit A/D. 

■ If the sampling rate satisfies the sampling theorem, that is, (O s > 2 co M , where 
( 0 M is the bandwidth of the continuous-time signal, then there will not be any 
aliasing in X (e ja ). 

DT/CT Operator 

The discrete-time to continuous-time DT/CT conversion operator in Figure 15.17 
consists first of forming a train of impulses occurring every T s seconds, with the 
impulse at time nT s having an area y d (n\. This operation is simply the inverse of op- 
erator V defined in Equation 15.10, denoted as V -1 . Then, an ideal lowpass filter 
with its cutoff frequency set at the Nyquist frequency (O c = co s /2 and with a gain 
of T s is applied to the impulse train, as shown in Figure 15.21. 



FIGURE 15.21 DT/CT conversion operator. 
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Remarks: 

■ A digital-to- analog (D/A) converter is the practical device used to implement 
the ideal DT/CT operation. Typical D/A converters use a ZOH in place of the 
ideal lowpass filter. 

■ If the discrete-time signal comes from a sampled continuous-time signal for 
which the sampling theorem was satisfied, then it should be clear that DT/CT 
will recover the continuous-time signal perfectly. 



((Lecture 61: Equivalence to Continuous-Time Filtering; Sampling of Discrete- 
Time Signals)) 


Equivalence to a Continuous-Time LTI System 

Can the system depicted in Figure 15.22 be equivalent to a purely continuous-time 
LTI system as represented by its frequency response H(jco)7 The answer is yes, but 
only for input signals of bandwidth co M < f. In this case, the frequency response 
up to the Nyquist frequency of the equivalent continuous-time LTI system is given 

by 


H(Jco)=H d (e jaT >). (15.15) 

Thus, an input signal of bandwidth co M < ^ in the block diagram of Figure 
15.22 would have its spectrum compressed from the frequency interval [-64/2, 
m/2] to the discrete-time frequency interval [-71, n] via the mapping Q = coT s be- 
fore being filtered by H d (e jn ). 



T s T s 


FIGURE 15.22 Sampled-data system. 


An important question remains: suppose we want to design a sampled-data sys- 
tem that would match the behavior of, for instance, a high-order Butterworth filter 
that was previously designed as a continuous-time system with transfer function 
H b {s). Further assume that the input signals are known to have a bandwidth lower 
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than the Nyquist frequency. How can we design such a system? What is required 
is a discrete-time version of the Butterworth filter represented by a transfer func- 
tion in the z- domain H Bd (z), which can be obtained through discretization of the 
system H B (s). Discretization of a continuous-time system is discussed in Chapter 
17. In an algorithm implementing the middle block of the sampled-data system of 
Figure 15.22, the discretized system H Bd (z) would be programmed either as a re- 
cursive difference equation, a convolution, or sometimes as a recursive state-space 
system. 


SAMPLING OF DISCRETE-TIME SIGNALS 


With the growing popularity of digital signal processing and digital communica- 
tions, more and more operations on signals normally carried out in continuous 
time are implemented in discrete time. For example, modulation and sampling can 
be done entirely in discrete time. In this section, we look at the process of sampling 
discrete-time signals and the related operations of decimation and upsampling. 

Impulse Train Sampling 

+°° 

Let v[n\ be a discrete-time impulse train of period N s ; that is, v[ n ] = X 8\n - kN s ] . 
Then, impulse train sampling of x\n\ is defined as 

+<x> 

x s [n\ := x[n\v[n\ = x[kN s ]S[n - kN s ]. (15.16) 

k~-°° 

In the frequency domain, this corresponds to the periodic convolution of the 
DTFTs: 


X s (e im ) = — f V(e je )X(e J(o, - 0) )de, (15.17) 

ln L 

where 

9 jr +“ 

V(e j(0 ) = — X 5 (C0 ~ k(O s ), (15.18) 

N s k=-oo 
2n 

and co s , 0 <a> s <2n , is the discrete-time sampling frequency. Thus, the 
spectrum of the sampled signal is given by 




558 Fundamentals of Signals and Systems 


X s (e jm ) = (15.19) 

k = 0 

Note that X s (e J0> ) is a finite sum over k = 0,...,N S - 1 , as the convolution in 
Equation 15.17 is computed over an interval of width 2jt, for example, over 
[- n,n ] , and there are only N, impulses in V(e jm ) in this interval. 

Example 15.3: A signal x\n\ with DTFT shown at the top of Figure 15.23 is 

band- limited to ji/ 4. The signal is sampled at twice the bandwidth of the signal, that 

is, with a sampling frequency (U s = * corresponding to the sampling period N s = 4 
and yielding x s [ri\ = x[n\v[n\ . The DTFT V(e j0> ) of the impulse train v\n\, which 
is convolved with the signal spectrum, is composed of impulses located at integer 
multiples of co s = 




FIGURE 15.23 Discrete-time sampling in the frequency domain. 


((Lecture 62: Decimation, Upsampling and Interpolation)) 
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Decimation 

Recall that impulse train sampling of x\ri\, defined as x s [n\ = x[ri\v[ri\ = 
X x[kN s ]8[n-kN s ], yields the spectrum X s (e lco )= — % X{e i{co ~ k "° s) ). The 

k=—°° ‘ > k=0 

purpose of decimation is to compress a discrete-time signal, but the sampled sig- 
nal x s [n ] still has N s - 1 zeros in between the values of x[nN s \, carrying no infor- 
mation. Decimation gets rid of these zeros after sampling, thereby compressing the 
number of values in x[n ] and xfn\ by a factor N s . 

The signal x lN | n\ := x[N s n ] is called a decimated, or downsampled, version 
of x[n\, that is, only every NJ h sample of x[«] is retained. Also note that 
x Lv |«| = a;|A «]. 

In a real-time communication system, this means that the decimated signal can 
be transmitted at a rate N s times slower than the rate of the original signal. It also 
means that for a given channel with a fixed bit rate, more decimated signals can be 
transmitted through the channel at the same time using time-division multiplexing 
(more on this in Chapter 16). 

Frequency Spectra of Decimated Signals 

Let the integer N > 1 be the sampling period. The DTFT of a downsampled signal 
is given by 

n=- oo 

= £ x[nN]e- jmn 

n=—oo 

+oo . m . (o 

= X x s [m\e 1<0 " = X,{e"). (15.20) 


Thus, X lN (e JC0 ) = X s (e' N ); that is, the spectrum of the decimated signal 
x u ,| n] is the frequency-expanded version of the spectrum of the sampled signal 
x s [n\. 

Example 15.4: Consider the signal x\n\, whose Fourier transform shown in the 

top plot in Figure 15.24 has a bandwidth of 7t/4. The signal x iA [n \ , decimated by 
a factor of 4, has the DTFT shown at the bottom of the figure, while the signal x s \n\, 

7Z 

sampled at frequency = y corresponding to the sampling period N = 4, has the 
DTFT in the middle. It can be seen that the spectrum X u (e ' 0> ) is a stretched ver- 
sion of Xfe Jb> ), expanded by a factor of /V = 4. 
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FIGURE 15.24 Effect of downsampling in the frequency domain. 


Aliasing (B 

What happens if the sampling period N is a large number? Can X lN (e J0> ) = X s (e N ) 
expand so much that it is no longer a periodic spectrum of period 2jt? No. In this 
case, aliasing occurs in X s (e Jm ), but the center of the first (distorted) copy of the 
spectrum to the right of the main one (centered at co = 0) is at frequency — in 
X s (e J0> ). This means that the aliased X,(e JC ") is periodic of period 27t. Its subsequent 

.ft) 

expansion through decimation by a factor of N brings back X, (e ,m ) = X s (e N ) to 
a period of 27t, with the first copy of the spectrum to the right of the main one now 
being centered at co = 2n. 

Aliasing occurs when co s = ^ < 2 co M , where C 0 M is the bandwidth of the signal, 
in both operations of sampling and decimation. This is the discrete-time version of 
the sampling theorem. 


Reconstruction of Decimated Signals: Upsampling and Interpolation 

Recall that the upsampling operation is defined as: 

f x[n/N\, if n is a multiple of N 
-T„|A1 : = \ 

TiV [ 0, otherwise 


( 15 . 21 ) 
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The upsampling operation inserts A- 1 zeros between consecutive samples of 
the original signal. The Fourier transform of the upsampled signal x^ N [n\ is given 
by 


x TiV [n]Ax (e jNa ); (15.22) 

that is, its spectrum is a frequency-compressed version of X(e J0> ). 

Assume that a signal x[«] was downsampled to x, N [ n ] without aliasing. The 
signal x[n] can be recovered from its downsampled version by first upsampling the 
decimated signal, shown as the block labeled t A in Figure 15.25, followed by 
lowpass filtering with an ideal lowpass filter of cutoff frequency (O c = y = ^ and 
gain A. 


Ta-M 

t N 

x s [n] 

I 

w 

1 

x[n] 



_l 

n 
~ N 

— J - *- 

N 



NH lp (e-’n 


FIGURE 15.25 Upsampling followed by lowpass filtering for 
signal reconstruction after decimation. 


Example 15.5: The decimated signal x^ 4 [«] of the previous example is upsam- 

pled by a factor of 4, yielding the signal x s \n\, with three zeros inserted in-between 
each sample. The ideal lowpass filter interpolates the samples and turns the inserted 
zeros into the original values of the signal, as shown in Figure 15.26. Figure 15.27 
illustrates the operations used to reconstruct the decimated signal in the frequency 
domain. 

Notice in Figure 15.27 how the upsampled signal has copies of the main part 
of the spectrum at high frequencies (around ± 71 ). These high-frequency compo- 
nents (coming from the fast variations in the upsampled signal that flips between 
sample values and the inserted zeros ) must be removed by the lowpass filter 
4 H lp (e im ) to recover x[n]. 

Maximum Decimation 

Maximum signal compression through decimation (without aliasing) can be 
achieved by expanding the bandwidth co M of the original signal spectrum up to 7t. 
However, it is usually not possible to do this exactly, as decimation results in spec- 
tral expansion by an integer factor A. 
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FIGURE 15.26 Time-domain view of 
upsampling followed by lowpass filtering for 
signal reconstruction after decimation. 



FIGURE 15.27 Frequency-domain view of upsampling followed 
by lowpass filtering for signal reconstruction after decimation. 
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One way to expand the spectrum up to, or close to, n is to upsample the signal 
first (followed by lowpass filtering) and then to decimate it. This two-stage proce- 
dure can produce a rational spectral expansion factor, which can bring the edge of 
the spectrum arbitrarily close to n. 

Example 15.6: Suppose that the discrete-time signal to be downsampled to reach 

2 n 

maximal decimation has a bandwidth of s . Then, we require a rational 

spectral expansion factor of to bring the edge of the DTFT of the signal to n. This 
is clearly impossible to achieve with decimation alone, which at best could expand 
the spectrum by a factor of 2 without aliasing with N - 2. The trick here is to up- 
sample by a factor of 2 (insert a 0 between each value of x[«]) first, thereby com- 
pressing the spectrum to a bandwidth of y, and then to apply an ideal lowpass filter 
to remove the unwanted replicas centered at frequencies ±7t in X^ 2 (e J01 ) , which 
could cause aliasing to occur. Finally, the upsampled filtered signal with DTFT 
X^ 2lp ( ejm ) is decimated by a factor of 5 to obtain a bandwith of n. These operations 
are shown in Figure 15.28. 

Remark: Because aliasing of the spectrum of the upsampled signal can easily 
occur in the decimation operation, upsampling should be followed by lowpass filtering 
with unity gain and cutoff frequency 0 ) c = — 9 where /V is the upsampling factor. 



FIGURE 15.28 Maximal decimation via upsampling 
followed by decimation. 
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SUMMARY 


Sampling was introduced in this chapter as an important bridge between continuous- 
time and discrete-time signals, with the focus of processing continuous-time sig- 
nals using discrete-time systems. 

■ The sampling theorem establishes a sufficient condition on the sampling rate 
for a continuous-time signal to be reconstructed from its sampled version. 
Sampling is easier to understand in the frequency domain. 

■ Perfect signal reconstruction from the samples can be done with a perfect low- 
pass filter. Imperfect, but simpler, signal reconstruction can be performed 
using a zero-order hold or a first-order hold. 

■ Discrete-time processing of a continuous-time signal is theoretically equivalent to 
filtering with a corresponding continuous-time system within a frequency band 
extending to half of the sampling frequency, provided the proper setup is in place. 

■ Sampling of discrete-time signals leads to the important operations of decima- 
tion and upsampling. These operations can be used for discrete-time signal 
compression in communication systems. 


TO PROBE FURTHER 


On sampling systems, see Oppenheim, Schafer and Buck, 1 999 and Proakis and 
Manolakis, 1995. Decimation and upsampling are covered in Oppenheim, Willsky, 
and Nawab, 1997 and in Haykin and Van Veen, 2002. 


EXERCISES 

Exercises with Solutions 

Exercise 15.1 

The system shown in Figure 15.29 filters the continuous-time noisy signal 
x n ( t ) = x(t ) + n(t) composed of the sum of a signal x(t) and a noise n(t). 



n(l) T’ t s 


FIGURE 15.29 Sampled-data system with antialiasing filter of Exercise 1 5.1. 
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The signal and noise have their respective spectrum, X(jco), N(jco) shown in 
Figure 15.30. The frequency response of the antialiasing lowpass filter is also 
shown in the figure. 


XUco) 


H „{]«>) 


-500 On 

500 On Qf 

-600 On 

-400 On 

moo 600 On 
400 On 

CO 



N(jw) 

[0.2 


... 


i 


-500 On 

500 On 

CO 


FIGURE 15.30 Antialiasing filter and signal and noise spectra in 
Exercise 15.1. 


(a) Let the sampling frequency be co s = 1 IOOOtt rad/s. Sketch the spectrum 
W(jco) of the signal w(t). Also sketch the spectrum W d (e ja ). Indicate the 
important frequencies and magnitudes on your sketch. Discuss the results. 


Answer: 

The Nyquist frequency is ^ = 5500 tt. The spectra W( jco) and W d (e' n ) are shown 
in Figure 15.31. 



▲ 



FIGURE 15.31 Fourier transform of output of antialiasing filter 
and DTFT of signal after CT/DT (Exercise 15.1). 
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(b) Design an ideal discrete-time lowpass filter KH lp (e ja ) (give its cutoff 
frequency Q c and gain K) so that the signal x(t) (possibly distorted by lin- 
ear filtering) can be approximately recovered at the output. Sketch the 
spectrum Y d (e jS1 ) with this filter. 


Answer: 

From Figure 15.31, the ideal lowpass would have a cutoff frequency Q - "' K in 
order to remove the remaining noise, and unity gain since the DT/CT operator 
already contains a gain of T s . The frequency response of the lowpass filter 
H /p (e jn ) is shown in Figure 15.32, and the DTFT of the output of the filter 
Y d (e ja ) is in Figure 15.33. 


U lp (e ia ) 
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... 
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FIGURE 15.32 Frequency response of ideal lowpass filter (Exercise 15.1). 



2k 


* 
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FIGURE 15.33 DTFT of output of ideal lowpass filter (Exercise 15.1). 


(c) Sketch the spectrum Y(jco) and compute the ratio of linear distortion in the 

E 

output y(t) with respect to the input signal; that is, compute 100 x in 
percent, where E error : energy of x(t) - y(t), E x : energy of x(t) . 



Sampling Systems 567 


Answer: 

The Fourier transforms of the output Y(jco) and the error signal X(jco) - Y(jco) are 
sketched in Figure 15.34. 
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FIGURE 15.34 Fourier transforms of continuous-time output signal 
and error signal (Exercise 15.1). 


The energy of the signal and the energy of the error signal are computed using 
the Parseval equality as follows. 


^ 5000 7T ^ 5000 7T 

E x = — f \X(jco)\ 2 dco = — f dco = 5000 

9 7 T J 0 TT " 


- 5000 k 
5000 k 


+ 5000 7T h 5000 7T 

E error =2y~ j \X{jCO) ~Y {jCof dCO = ~ J 

^ 4000 s: " 4000 s 


j (co-4000TT) 2 r/« = 


1 


2000 tt 
1 


dco 


2000 2 7T 3 


4000 7T 


(3)(2000 2 )tt 3 


(co - 4000 7r) 
[(«-4000 tt) 3 ] 


5000# 

4000# 


1 


(3)(2000 2 )tt 3 
Ratio of linear distortion: 
E 


[(50007T-40007T) 3 -0] = 


iooo 3 ^ 3 

(3)(2000 2 )7r 3 


1000 

12 


= 83.3 


1000/12 

5000 


x 100% = 1.67% 
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Exercise 15.2 

Consider the discrete-time system shown in Figure 15.35, where X N represents 
decimation by N. The operator {T N }, p denotes upsampling by N followed by an 
ideal unity-gain lowpass filter with cutoff frequency This system transmits a 
signal x[«] that comes in at a rate of 100 kilosamples/second over a channel with 
limited bit-rate capacity. At each time n, the 16-bit quantizer rounds offs the real 
value x 2 [n] to a 16-bit value y\ri\. 



channel 


FIGURE 15.35 Block diagram of discrete-time system (Exercise 15.2). 


(a) Given that the input signal x\n\ is bandlimited to 0. 1 3jt radians, find the in- 
tegers N u N 2 that will minimize the sample rate for transmission over the 
channel. Give the bit rate that you obtain. 


Answer: ^ ^ ^ 

Bandwidth of signal x[n\. <*>„, = ^ ■ We want the DTFT ofx 2 [«] to cover as 

much of the frequency interval [-71, tc] as possible using upsampling and decima- 
tion. We can upsample first by a factor of /V, = 13, which compresses the band- 
width to and then we can decimate by a factor of N 2 = 100 to expand the spec- 
trum up to 7t. The resulting sample rate is reduced by a factor of ^ to 13 
kilosamples/s. With a 1 6-bit quantizer, the bit rate needed to transmit the signal 
y[n] is 16 bits/sample x 13,000 samples/s = 208,000 bits/s. 

(b) With the values obtained in (a), assume a triangular spectrum for x[n] of 
unit amplitude at DC and sketch the spectra X ( <?"" ) , X, (e J<0 ) , X 2 (e J<0 ), 
indicating the important frequencies and magnitudes. 


Answer: 

The spectra X(e' 10 ), X t (e J0J ), X 2 (e J0> ) are sketched in Figure 15.36. 
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Exercises 

Exercise 15.3 

The signals below are sampled with sampling period T s . Determine the bounds on 
T s that guarantee there will be no aliasing. 

(a) x(t) = cos(lO^t) s “ 1 ( 7r? - ) 


(b) 


x(f) = e 4, u(t)* 


sin(WT) 

Kt 


Answer: 
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Exercise 15.4 

A continuous-time voltage signal lies in the frequency band |t»| < 5n rad/s. This 
signal is contaminated by a large sinusoidal signal of frequency 1 20 /r rad/s. The 
contaminated signal is sampled at a sampling rate of (O s = 13 n rad/s . 

(a) After sampling, at what frequency does the interfering sinusoidal signal 
appear? 

(b) Now suppose the contaminated signal is passed through an antialiasing fil- 
ter consisting of an RC circuit with frequency response H(jco) = R q (0+{ - 
Find the value of the time constant RC required for the sinusoid to be 
attenuated by a factor of 1000 (60 dB) prior to sampling. 

Exercise 15.5 

Consider the sampling system in Figure 15.37 with an ideal unit-gain, lowpass 
antialiasing filter HJjco), with cutoff frequency (O c , and where the sampling fre- 

In F 

quency is co s = — . 


*(0 


+ H lp (jco) 



",(0 


V(0= ^SU-kT) 

k=-co 


FIGURE 15.37 Sampling system in Exercise 15 . 5 . 


The input signal is x(t) = e ' u(t ) , and the sampling period is set at T = C . 

(a) Give a mathematical expression for X{jco), the Fourier transform of the 
input signal, and sketch it (magnitude and phase.) Design the antialiasing 
filter (i.e., find its cutoff frequency) so that its bandwidth is maximized 
while avoiding aliasing of its output w{t) in the sampling operation. With 
this value of co c , sketch the magnitudes of the Fourier transforms W(jco) 
and W s (jm). 

E 

(b) Compute the ratio of total energies r = 100 p in percent, where E„ :U . is the 
total energy in signal w(t) and E mx is the total energy in signal x(t). This 
ratio gives us an idea of how similar w{t) is to x{t) before sampling. Flow 

similar is it? (Flint: J = ~ arctan ^ j + C ) 
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Answer: 



ON THE CD 


Exercise 15.6 

Consider the sampling system in Figure 15.38, where the sampling frequency is 



The input signal is x(t) = sine 2 (y^'| and the spectra of the ideal bandpass 
filter and the ideal lowpass filter are shown in Figure 15.39. 



co 



FIGURE 15.39 Frequency responses of ideal lowpass and bandpass filters in 
Exercise 15.6. 


(a) Compute and sketc h X(jco), the Fourier transform of the input signal. For 

2.71 

what range of sampling frequencies co s = — is the sampling theorem sat- 
isfied for the first sampler? 

(b) Assume that the sampling theorem is satisfied with the slowest sampling 
frequency co s in the range found in (a). Sketch the spectra Y( jco), W(jco), 
and Z(jco) for this case. 
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(c) Sketch the Fourier transforms X r (jco) and E(jco). Compute the total energy 
in the error signal e( t) := x(t) - x r (t) . 

Exercise 15.7 

Consider the sampling system in Figure 15.40, where the input signal is 
x(t) = ^ sine ( '*' t)and the spectra of the ideal bandpass filter and the ideal lowpass 
filter are shown in Figure 15.41. 


.v(/) 



v(0= X s (*- kT s ) q(l) = e J "■ , 

k—oo 

FIGURE 15.40 Sampling system in Exercise 15 . 7 . 




FIGURE 15.41 Frequency responses of the ideal lowpass and bandpass filters 
in Exercise 1 5 . 7 . 


(a) Find and sketch X(jco), the Fourier transform of the input signal 
x(t) = A sine ( E t ) ■ For what range of sampling frequencies 0 ), = 2 E is the 
sampling theorem satisfied? 

(b) Assume that the sampling theorem is satisfied with CO, = 3VF for the re- 
maining questions. Sketch the Fourier transforms Y(jco) and W(jco). 

(c) Sketch the Fourier transforms Z(jco) and X r (,jco). 

(d) Using the Parseval equality, find the total energy of the error signal e(t), 
defined as the difference between the input signal x(t) and the “recon- 
structed” output signal x,(t). 
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Answer: 



ON THE CD 


Exercise 15.8 

The system depicted in Figure 15.42 is used to implement a continuous-time band- 
pass filter. The discrete-time filter H d (e' n ) has frequency response on [-Jt, n] 
given as 

fl, Q <|Q|<£1 
H d (e ja ) = \ a 1 1 6 

[ 0, otherwise 

Find the sampling period T„ and frequencies Q a , £2 h , and W , so that the equiv- 
alent continuous-time frequency response G(jco) satisfies G(jcd) = 1 for 
IOOtt < | co | < 200 /r, and G(jcd) = 0 elsewhere. In solving this problem, choose W , 
as small as possible and choose T s as large as possible. 



FIGURE 15.42 System implementing a continuous-time bandpass filter in 
Exercise 15.8. 


Exercise 15.9 

The signal x[«] with DTFT depicted in Figure 15.43 is decimated to obtain 
x iA [n\ = x[An\. Sketch X u (e ja> ). 


X(e j ”) 
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" M; 

-K 

o T ► 

fE. 71 CO 

4 

4 


FIGURE 15.43 DTFT of signal in Exercise 15.9. 
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Answer: 



ON THE CD 


Exercise 15.10 

Suppose that you need to transmit a discrete-time signal whose DTFT is shown in 
Figure 15.44 with a sample rate of 1 MFIz. The specification is that the signal 
should be transmitted at the lowest possible rate, but in real time; that is, the signal 
at the receiver must be exactly the same with a sample rate of 1 MFIz. Design a sys- 
tem (draw a block diagram) that meets these specs. Both before transmission and 
after reception, you can use upsampling-filtering denoted as {T N } ip , decimation 
denoted as i N, ideal filtering, modulation, demodulation, and summing junc- 
tions. (You might want to read the section on amplitude modulation and synchro- 
nous demodulation in Chapter 16 first.) 



FIGURE 15.44 Spectrum of discrete-time signal to be transmitted 
in Exercise 15.10. 


Exercise 15.1 1 

Consider the decimated multirate system shown in Figure 1 5.45 used for voice data 
compression. This system transmits a signal x{n\ over two low-bit-rate channels. 
The sampled voice signal is bandlimited to ( 0 M = 2 ( T . 



FIGURE 15.45 Decimated multirate system in Exercise 15.1 1. 
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Numerical values: 

■ Input lowpass filter’s cutoff frequency (O clp = | 

■ Input highpass filter’s cutoff frequency (O chp = | 

f, 5 , , , , 2 k 

i — M, |w|< — 

■ Signal’s spectrum over [ tc, ji]: X(e J0> ) = \ ln ^ 5 

0, <\(0\<K 

y 5 1 1 

(a) Sketch the spectra X(e’ 0> ), X ] (e J(0 ), and X 2 (e JC0 ), indicating the important 
frequencies and magnitudes. 

(b) Find the maximum decimation factors TV, and N 2 , avoiding aliasing, and 
sketch the corresponding spectra V 1 (e J< "), V 2 (e jco ), W x (e JO> ), and W 2 (e J0> ), in- 
dicating the important frequencies and magnitudes. Specify what the ideal 
output filters H x (e j(0 ) and H 2 {e j(0 ) should be for perfect signal reconstruc- 
tion. Sketch their frequency responses, indicating the important frequen- 
cies and magnitudes. 

(c) Compute the ratio of total energies at the output between the high- 
frequency subband y 2 [n\ and the output signal x[n]; that is, compute 

r := 100 -f 1 - % , where the energy is given by E xy := £ |y[n]| . 

(d) Now suppose each of the two signal subbands Vj[«] and v 2 [»] are quantized 
with a different number of bits to achieve good data compression, without 
losing intelligibility of the voice message. According to your result in 
(c), it would seem to make sense to use fewer bits to quantize the high- 
frequency subband. Suppose that the filter ha nk operates at an input/output 
sample rate of 10 kHz, and you decide to use 12 bits to quantize Vj [w] and 
4 bits to quantize v 2 [«]. Compute the bit rates of channel 1 and channel 2 
and the overall bit rate of the system. 


Answer: 
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Communication Systems 


In This Chapter 

■ Complex Exponential and Sinusoidal Amplitude Modulation 

■ Demodulation of Sinusoidal AM 

■ Single-Sideband Amplitude Modulation 

■ Modulation of a Pulse-Train Carrier 

■ Pulse-Amplitude Modulation 

■ Time-Division Multiplexing 

■ Frequency-Division Multiplexing 

■ Angle Modulation 

■ Summary 

■ To Probe Further 

■ Exercises 



((Lecture 63: Amplitude Modulation and Synchronous Demodulation)) 

T he field of telecommunications engineering has radically changed our lives 
by allowing us to communicate with other people from virtually any loca- 
tion on earth and even from space. Who could have imagined two hundred 
years ago that this could ever be possible? The study of communication systems is 
largely based on signals and systems theory. In particular, the time-domain multi- 
plication property of Fourier transforms is used in amplitude modulation. This 
chapter is a brief introduction to the basic theory of modulation for signal trans- 
mission. 
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COMPLEX EXPONENTIAL AND SINUSOIDAL 
AMPLITUDE MODULATION 


Recall the time-domain multiplication property for Fourier transforms: the multi- 
plication of two signals results in the convolution of their spectra: 

FT 1 

x(t)y(t) — X(J<o) * Y{j(o). (16.1) 

in 

Amplitude modulation (AM) is based on this property. For example, consider 
the modulation system described by 

y(t) = x(t)c(t), (16.2) 

where the modulated signal y(t ) is the product of the carrier signal c(t) and the 
modulating signal x(t), also called the message. The carrier signal can be a complex 
exponential or a sinusoid, or even a pulse train. 

An important objective in modulation is to produce a signal whose frequency 
range is suitable for transmission over the communication channel to be used. In 
telephone systems, long-distance transmission is often accomplished over mi- 
crowave (300 MHz to 300 GHz) or satellite li nk s (300 MHz to 40 GHz), but most 
of the energy of a voice signal is in the range of 50 Hz to 5 kHz. Hence, voice sig- 
nals have to be shifted to much higher frequencies for efficient transmission. This 
can be achieved by amplitude modulation. 

Amplitude Modulation with a Complex Exponential Carrier 

In amplitude modulation with a complex exponential carrier, the latter can be writ- 
ten as 


c(t) = e J(< ° c ‘ +e ^ , (16.3) 

where the frequency (O c is called the carrier frequency. Let 6 r = 0 for convenience. 
We have seen that the Fourier transform of a complex exponential is an impulse of 
area 271, so that 


C(jco) = 2 nd(co - co c ). 

The frequency-domain convolution of C( jcd) and X(jco) yields 


(16.4) 
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Y(jCO) = ^-X(jCO)*C(jCO) 
in 

+oo 

= J X(jv)8(co-v-co c )dv 

+00 

= J X(jv)8(-(v-(co-co c ))dv 

+OO 

= J X(jv)8(v-(co-CQ c ))dv 

= X(J(C0-C0 c j). (16.5) 

Thus, the spectrum of the modulated signal y(t) is that of the modulating sig- 
nal x(t) frequency-shifted to the carrier frequency, as shown in Figure 16.1. 



FIGURE 16.1 Amplitude modulation with a complex exponential carrier. 

An obvious demodulation strategy would be to multiply the modulated signal 

by e~ i( ° c ‘ 

y(t)e~ Ja>c< = x(t)e j01c ‘ e~ J< ° c ' = x(t). (16.6) 

In the frequency domain, this operation simply brings the spectrum back 
around (0 = 0. 

Amplitude Modulation with a Sinusoidal Carrier 

In sinusoidal amplitude modulation, the carrier signal is given by 


c(t) = cos(ft) t + 6 c ). 


(16.7) 



580 Fundamentals of Signals and Systems 


Sinusoidal AM can be represented by the diagram in Figure 16.2, where the 
modulated signal y(t) is fed into an antenna for transmission. 

cos (CO c t + e c ) 

y(0 77 antenna 

I 

► J 

FIGURE 16.2 Diagram of sinusoidal AM. 

Again, let 8 = 0 for convenience. The spectrum of the carrier signal is 

C(jco) = nd(CQ + co c ) + nd(co - a > c ), (16.8) 

and the spectrum of the modulated signal is obtained through a convolution: 

Y(jco) = ^-X(jco)*C(jco) 

Lit 

= ^X ( j(co + C 0 c )) + ^X(j(( 0 -C 0 c )). (16.9) 

We see in Figure 16.3 that there are two replicas of X(jco), one at 0 ), and the 
other at -co c . 




FIGURE 16.3 Sinusoidal AM in the frequency domain. 
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Note that the two copies of the original spectrum can overlap if the carrier fre- 
quency is not high enough, that is, if 0 ), <(0 M , which is not the case for AM with a 
complex exponential carrier. The modulating signal may be unrecoverable if this 
happens. 


DEMODULATION OF SINUSOIDAL AM 


In a communication system, the information-bearing (modulating) signal x(t) is re- 
covered at the receiver end through demodulation. There are two commonly used 
methods for sinusoidal AM demodulation: synchronous demodulation, in which 
the transmitter and receiver are synchronized and in phase, and asynchronous 
demodulation, which does not require accurate knowledge of the carrier signal. 

Synchronous Demodulation 

Assuming that co c > m M , synchronous demodulation is straightforward. Consider 
the modulated signal to be demodulated: 


y(t) = x(t)cos((Q c t). (16.10) 

If we multiply this signal again by the carrier cos (cot) at the receiver, that is, 

w(t) = y(t)cos(CQ c t), (16.11) 

then the two replicas of Y( jco) will be such that the left part of one adds up to the 
right part of the other, thereby reforming the original spectrum of x(t) around 
(0=0. Then x(t) can be recovered by an ideal lowpass filter with a gain of 2 and 
cutoff frequency co co , satisfying co M < (O co < 2m - m M . This principle of synchro- 
nous demodulation is illustrated by Figure 16.4. 

Also, using the trigonometric identity, 


9 1 1 

cos (m c t) = — + — cos(2m c t). 


(16.12) 


we can express the signal m(t) as follows: 


w(t) = x(t) cos 2 (m c t) 

= ^-x(t) + ^x(t)cos(2m t), 


(16.13) 
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where it is clear that the message is recovered in the first term, and the second term 
is akin to an amplitude modulation at twice the carrier frequency, which is subse- 
quently removed by lowpass filtering. 
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FIGURE 16.4 Synchronous demodulation of sinusoidal AM. 


Now, suppose that the receiver and the transmitter use exactly the same carrier 
frequency, but with a phase difference, that is, 

c (t) = cosfco t + 9 ), (16.14) 

transm v cc /7 v/ 

and 

c r Jt) = cos(coj + (l) c ). (16.15) 

Then, using the trigonometric identity 

cos(co t + 9 )cos(cu t+0 ) = — cos(0 -0 ) + — cos(2<y t + 9 +0 ), (16.16) 

c c c c 2 c c 2 C c c 

we have 


w(t) = ^-x(t)cos(0 c -0 c ) + ^x(t)cos(2o) c t + O c +0 c ). 


(16.17) 
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This means that the amplitude of the signal recovered at the output of the 
lowpass filter is smaller than the original amplitude by a factor of cos(0 — 0 ). In 
particular, when the demodulating carrier is out of phase by n/2, the output of the 
demodulator is zero. 

Equation 16.17 also helps explain the beating phenomenon heard on some 
older radio receivers in which the volume of a demodulated voice or music signal 
seems to periodically go up and down. Suppose that the phase of the receiver’s 
carrier is actually the linear function of time </) = St, where 8 is a very small real 
number in proportion to the carrier frequency. In this case, the carrier frequency 
used by the receiver is slightly off with respect to the carrier frequency used to 
modulate the signal as 

c r Jt) = cos {cat + 0 c (O) = cos((co c + 8)t). (16. 1 8) 

Then, Equation 16.17 becomes 

w(t) = — x(t)cos(5? + 0 ) + — x(t)cos(2co t + 6 +(f> ), (16.19) 

2 c 2 c c c 


where the amplitude of the first term containing the message is affected by a sinu- 
soidal gain cos((5t + 0), which produces the beating effect. 
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Asynchronous Demodulation 

In contrast to synchronous demodulation of AM signals, asynchronous demodula- 
tion does not require that the receiver have very accurate knowledge of the carrier’s 
phase and frequency. Asynchronous demodulation is used in simple AM radio re- 
ceivers: it is a cheap, but lower quality, alternative to synchronous demodulation. 

Asynchronous demodulation involves a nonlinear operation and is therefore 
easier to understand in the time domain. Suppose that we add a positive constant to 
the signal to be transmitted before modulation: 

y(O = [^ + x(i)]cos(c0 e O, (16.20) 

where A is large enough to make A + x(t ) > 0, V/. This amounts to transmitting the 
carrier signal as well as the modulated signal. Let K be the maximum amplitude of 
x(t), that is, x(/)| < K, and assume A>K. The modulation index m is the ratio 

m := K/ A. 


(16.21) 
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The modulating signal x(t) turns out to be the envelope of the modulated sig- 
nal y(t), as the example in Figure 16.5 shows with A = 1 and m = 0.3. 


C(/) X(l) 



FIGURE 16.5 AM signal with a 0.3 modulation index. 


Thus, the asynchronous demodulator should be an envelope detector. An en- 
velope detector such as the one in Figure 16.6 can be implemented with a simple 
RC circuit and a diode. 



FIGURE 16.6 Envelope detector 


The diode half-wave rectifies the signal. When the voltage y(t) gets higher than 
the capacitor voltage, the latter follows y(t). When y(t) drops below the voltage of 
the capacitor, the diode switches off and the capacitor discharges through the re- 
sistor with time constant z= RC. The resulting signal w(t) is shown in Figure 16.7. 
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FIGURE 16.7 Detector output in asynchronous 
demodulation of an AM signal. 


The envelope detector circuit is normally followed by a lowpass filter to get rid 
of the components at frequencies around the carrier frequency. This would smooth 
out the jagged graph of signal w(t) in Figure 16.7. 

Example 16.1: Let us design an envelope detector to demodulate the AM 

signal: 


y(t) = [l + 0.5cos(2007fr)]cos(27rl0 6 t). (16.22) 


The output voltage of the detector, going from one peak at voltage V] to the 
next when it intersects the modulated carrier at voltage v 2 after approximately one 
period T= 1 /us of the carrier, is given by: 


v 2 = v? 


(16.23) 


Since the time constant t = RC of the detector should be large with respect to 
T= 1 i^s we can use a first-order approximation of the exponential such that 

v 2 = Vj(l -T/RC). (16.24) 

V, 

This is a line of negative slope - RC between the initial voltage v, and the final 
voltage v 2 so that 


v — V 
v 2 y \ 


1 

RC' 


T 


(16.25) 
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This negative slope must be steeper than the maximum negative slope of the 
envelope of y(t), denoted as envjy(t)}, which is obtained as follows. 


rfenv{y(T)} 


■ mm 


dt 

deny j y(t) [ 

i-n — 

dt 


-IOOtt sin(200TrO 


-IOOtt 


(16.26) 


Taking the worst-case voltage v, = 0.5, in the sense that must still be 

below — 1 OOtc with this voltage, we must have 

--^-c -IOO tt 
RC 

RC<-^- = 0.0016 s. (16.27) 

IOOtt 

Thus, we could take R = 1 kQ, C = 1 to get RC = 0.001 s. 

Remarks: 

■ The envelope detector circuit works best when the modulation index m is 
small. This is because large variations in the envelope (negative derivative) for 
m close to 1 are “difficult to follow” by the detector since the capacitor dis- 
charge rate is fixed. The tradeoff in the choice of the time constant of the de- 
tector is that a small time constant is desirable for such fast variations of 
negative slope, but on the other hand, a large time constant is desirable to min- 
imize the amount of high-frequency ripple on w(t). 

■ A small modulation index m means that a large part of the power transmitted 
is “wasted” on the carrier, which makes the system inefficient. 

■ AM radio broadcasting uses sinusoidal AM, and the previous generation of re- 
ceivers typically used asynchronous envelope detectors. 


((Lecture 65: Single Sideband Amplitude Modulation)) 
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SINGLE-SIDEBAND AMPLITUDE MODULATION 


There is redundancy of information in sinusoidal AM. Two copies of the spectrum 
of the original real signal of bandwidth co M are shifted to 0 ) c and ~(O c , each one now 
occupying a frequency band of width 2 co M . Because bandwidth is a valuable com- 
modity, we would like to use the redundancy in the positive and negative frequen- 
cies to our advantage. 

The idea behind single-sideband AM (SSB-AM) is to keep only one half of the 
original spectrum around (O c and to keep the other half around -C0 c , as shown in Fig- 
ure 16.8. The net result is that instead of having a positive-frequency bandwidth of 
2 cq u , the modulated signal uses a bandwidth of (0 M only. 


1 

A 

X(jui) 

~ a hi 

co u 


Sinusoidal AM 



1/2 


-co c - co M 


-co c -a\ + ro hI 



CO 


Single-Sideband AM 
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-co c -co :U ~co e 
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1/2 



CO 


Single-Sideband AM 
(lower sidebands) 



1/2 


YAM 



-(O'. -co c + co AJ 


(O'. —C0 M (O'. 


FIGURE 16.8 Upper and lower single-sideband AM compared 
to sinusoidal AM. 


We can see from this figure that demodulation will consist of bringing the two 
halves of the original spectrum together around CO - 0. 
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Generating the Sidebands 

One obvious method to generate the upper sidebands is to use an ideal highpass fil- 
ter with cutoff frequency C0 c at the output of a sinusoidal AM modulator, as shown 
in Figure 16.9. 


COS® £ .f 

*'> K&rw. 


FIGURE 16.9 Upper SSB-AM using a highpass filter. 
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Similarly, the lower sidebands can be generated using an ideal lowpass filter 
(an ideal bandpass filter would also work) with cutoff frequency (O c following a 
sinusoidal AM modulator (see Figure 16.10). 


cos m l 

y,(t) 


FIGURE 16.10 Lower SSB-AM using a lowpass filter. 
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In practice, these techniques would require quasi-ideal filters with high cutoff 
frequencies, which can be difficult to design. Y et another technique to generate 
upper or lower sidebands is to use the system in Figure 16.1 1 with two modulation 
operations and a tt/2 phase-shift filter (this one keeps the lower sidebands). 



y(<) 


FIGURE 16.1 1 Lower SSB-AM using a phase-shift filter. 
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The upper path of the block diagram in Figure 16.1 1 produces the usual dou- 
ble-sideband spectrum Yfjco), while the lower path produces a negative copy of the 
upper sidebands in Y 2 (jco ), but keeping the lower sidebands intact. Thus, the sum 
of Yfjco) and Y 2 (jco) cancels off the upper sidebands and keeps only the lower side- 
bands. Note that the perfect phase-shifter, also called a Hilbert transformer, is im- 
possible to obtain in practice, but good approximations can be designed. 

To understand how the lower path works, let the spectrum of the modulating 
signal be decomposed as 

X(jco) = X (jco) + Xfjco), (16.28) 

where Xjjco) is the component at negative frequencies, and X+(jco) is the compo- 
nent at positive frequencies. Then, after filtering x(t) with the phase-shifter H(jcb), 
we obtain 


X p (ja>) = jX (jco)- jX + ( jco). (16.29) 

The spectrum of the sinusoidal carrier is 

C(jco) = jnd(co + co c )- jnd(co-co c ), (16.30) 

and that of the modulated signal y 2 (t) is 

K (j(») = f n x P O'®) * c (.i Q} ) 

= J'2 X p ( j(0) + w c )) - J 2 X p ( j {co ~ 03 < )) 

+ + + + (1631) 

Now, 

Yfjco) = X -X{j(co + coj) + l -X(j(o) - co c )) 

4[AL«® + »p )+ ^CA® + »,» + Ar. W »-».» + W»-® c ,)]. (16.32) 
Hence, 

Y(jco) = Yfjco) + Yfjco) = Xfj(co + co c )) + X_(j(co-co c )) (16.33) 
is composed of the lower sidebands only. 
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Demodulation 

Synchronous demodulation is required for SSB-AM/SC (single-sideband ampli- 
tude modulation, suppressed carrier). In SSB-AM/WC (single-sideband amplitude 
modulation with carrier), synchronous demodulation could be implemented with a 
highly selective bandpass filter to recover the carrier. Here it is assumed that the 
spectrum of the original signal has no energy around DC. A block diagram of the 
demodulator and the signal spectra are shown in Figure 16. 12. 


y ,(0 



X(jo)) 



FIGURE 16.12 Demodulation of lower single-sideband 
AM signal using a bandpass filter. 


Remarks: 

■ High resolution digital TV broadcasting (HDTV) uses a form of SSB-AM for 
signal transmission. 

■ Regular sinusoidal AM is often called double-sideband AM (DSB-AM). 

■ A phase-lock loop is sometimes used in the receiver to reproduce the carrier 
accurately and use it in a synchronous demodulator. The phase-lock loop is 
discussed in the section on angle modulation. 
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((Lecture 66: Pulse-Train and Pulse Amplitude Modulation)) 


MODULATION OF A PULSE-TRAIN CARRIER 


The carrier signal can be a train of finite rectangular pulses in the modulation 
system shown in Figure 16.13 and characterized by the equation y(t) = x(t)c(t). 
Define the rectangular pulse 


Pif) ■= ' 



A 

< — 

2 


0, otherwise 


and the pulse train 


+oo 

c(0 := X Pit-nT '). 

n=— oo 


(16.34) 


(16.35) 
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FIGURE 16.13 Pulse-train modulation. 


Let oo = — In the frequency domain, this modulation is quite similar to im- 
pulse train sampling, as we can see from Figure 16.14. The only difference is that 
the Fourier transform of c{t) in impulse train sampling is an impulse train of con- 
stant area, whereas here the areas of the impulses follow the “sine envelope” of the 
Fourier transform P(joo) of the pulse p(t). That is, the impulse areas are the Fourier 
series coefficients a k of c(t). 

The spectrum of the modulated signal is given by 

+oo 

Y(j(o)=Y J a k x (j((0-k(O c )), (16.36) 

k=—oo 


where 


sm(ko) A / 2) 

a, = 5 

k 


nk 


(16.37) 
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FIGURE 16.14 Pulse-train modulation in the frequency domain. 


The replicated spectra do not overlap in Y(jco) if the sampling theorem is 
satisfied, that is, if 0 ) >2 to The original modulating signal x(t) can then be 
recovered by lowpass filtering. Note that bandpass filtering around eo c = y would 
produce a DSB-AM spectrum. 

What is pulse-train modulation used for? It is used in time-division multiplex- 
ing, which will be studied later. 


PULSE-AMPLITUDE MODULATION 


We have seen that pulse-train modulation basically corresponds to time-slicing of the 
signal x(t). Based on the sampling theorem, it should be sufficient to use only one 
sampled value of the signal x(nT) rather than its whole continuous range of values 
over the pulse duration. This type of modulation is called pulse-amplitude modula- 
tion (PAM). The analysis is different from pulse-;train modulation: rather than ob- 
taining scaled, undistorted copies of the original spectrum in the modulated signal 
y(t), PAM creates some distortion in the spectral replicas in Y(Jcd). This distortion 
comes from the zero-order-hold (ZOH)-like operation as shown in Figure 16.15. 

The frequency response H 0 (jcd) of h 0 (t) is given by 

-ja>- / , \ -ja>- sin( co 4) 

H 0 (jco) = Ae 2 smc(^r«j = 2e 2 — — , (16.38) 

and the spectrum Y(jco) shown in Figure 16. 16 is given by 
y(ja>) = ^ £ X(j{m - kto c ))H 0 (jto). 

1 k=-oo 


(16.39) 
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FIGURE 16.16 Pulse-amplitude modulation in the frequency domain. 


The distortion caused by the sine frequency response H 0 (jco) can be substan- 
tially decreased by using narrow pulses, that is, choosing A small (although this 
may lead to a low signal-to-noise power ratio), and by using an inverse filter 
H^jco) = H~ l (jco ) before lowpass filtering at the receiving end. 

On the other hand, pulse-amplitude modulation is often demodulated by a 
CT/DT sampling operator at the receiver to create a discrete-time signal, which au- 
tomatically resolves the distortion problem. 
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Intersymbol Interference in PAM Systems 

PAM systems are time-domain based. The transmission of a PAM signal over a 
real communication channel is not easy. For example, let us consider a finite-band- 
width communication channel with a frequency response similar to a first-order 
system. The amplitude modulated pulses will get distorted and delayed through the 
channel, to the point where each pulse gets “smeared” in time and interferes with 
its neighbors. This is called intersymbol interference. 

Example 16.2: A PAM signal representing signal samples x(nT) = 1 with T= 1, 

A = 0.3 is transmitted through a first-order channel with frequency response 

H ch (jco) = 02/ rc +1 . The pulses at the output of the channel are plotted in Figure 
16.17, where we can see that each received pulse has an effect on the next ones. 



FIGURE 16.17 Transmission of a PAM signal 
through a first-order channel. 
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so that the pulse is transmitted undistorted since 


PU<o) = 


, | | K 

1 , \(0 < — 

I I T 

9 

„ | 1C 

0, \co\ > — 

I I T 


(16.42) 


and we assume that j <W . One potential problem with this strategy is that the 
sine pulse is of infinite duration. However, p(t) has zero crossings at each sampling 
instant so that only the contribution of the current pulse is sampled at the receiver. 
Obviously, the CT/DT operation at the receiver must be very well synchronized to 
sample y(t) at the right time. 

This may not be obvious, but with the ideal sine pulse p{t), the PAM signal is 
equal to x(t) (refer back to Figure 15.9). One might as well transmit the signal x(t) 
directly. The main benefit of using sine pulses is for time-division multiplexing 
(TDM), where many signals are pulse-amplitude modulated and multiplexed for 
transmission over a single channel. Then it is crucial to separate the pulses at the 
sampling instants; otherwise a phenomenon called crosstalk can occur. An exam- 
ple of crosstalk is when one is having a conversation on the phone and suddenly 
hears in the background someone else’s voice on a different call. 



((Lecture 67: Frequency-Division and Time-Division Multiplexing; Angle Modulation)) 


TIME-DIVISION MULTIPLEXING 


TDM is used to transmit more than one pulse-amplitude modulated signal over a 
single channel. TDM can be represented as a rotating switch connecting each sig- 
nal to the channel for a brief period of time, as shown in Figure 16.18. 



FIGURE 16.18 Time-division multiplexing of two signals. 
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As mentioned before, it is crucial to avoid intersample interference in such a 
system when y(t) is transmitted over a communication channel. Intersample inter- 
ference occurs in bandlimited channels (even with flat frequency responses). The 
use of sine pulses, or other types of bandlimited pulses with zero crossings at the 
sampling instants, can greatly reduce intersample interference. 

Demodulation 

The ideal demodulator for TDM in Figure 16.19 is composed of impulse train 
samplers synchronized with each PAM subsignal of y(t) (an operation called 
demultiplexing), followed by ideal lowpass filters to reconstruct the continuous- 
time signals. 
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FIGURE 16.19 Demodulation of a TDM signal. 


The structure of the demodulator depends on what format the demultiplexed 
signals should take at the receiver. For example, since TDM is often used for dig- 
ital communication systems, it might be desirable to generate discrete-time signals 
following the demultiplexing operation. In this case a CT/DT operation would re- 
place the impulse train samplers and the filters in Figure 16.19. A practical imple- 
mentation might use a synchronized analog-to-digital (A/D) converter sampling 
y(t) at the rate of 0 ) = An/T . Demultiplexing is then performed digitally in the 
processor. 

Non-Ideal Channels 

At least three types of distortion can occur when a TDM signal is transmitted over 
a realistic (non-ideal) communication channel: 
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■ Distortion caused by a finite bandwidth channel: the ideal rectangular pulse has 
a spectrum extending to infinite frequencies, and the high-frequency part of the 
spectrum cut off by the channel results in a distorted pulse causing intersym- 
bol interference. A solution to this problem is to use bandlimited pulses as pre- 
viously mentioned. 

■ Distortion caused by a channel with non-flat magnitude or nonlinear phase: 
this can distort the pulse so that its amplitude is changed and can also cause in- 
tersymbol interference. Channel equalization at the receiver using an equalizer 
can improve this situation. 

■ Distortion caused by additive noise: this situation can be improved by filtering 
if the power spectral density of the noise is outside of the bandwith of the TDM 
signal (using bandlimited pulses). If the noise cannot be filtered out, then 
pulse-code modulation (PCM) can be used if it is acceptable to quantize the 
amplitude of the original PAM signals to be transmitted. Suppose that the sig- 
nal amplitudes are quantized using 8 bits (256 values); then each of the 8 bits 
can be transmitted successively. In this case, the transmitted voltage pulses 
would represent either a 0 (e.g., 0 V) or a 1 (e.g., 10 V), and it should be easy 
to decide at the receiver whether it was a 0 or a 1 being transmitted, even in the 
presence of significant additive noise. 


FREQUENCY-DIVISION MULTIPLEXING 


Frequency-division multiplexing (FDM) is used to transmit more than one ampli- 
tude modulated (or frequency modulated) signal over a single channel. Note that 
FDM and TDM are dual modes of communication: TDM multiplexes and demul- 
tiplexes signals in the time domain using PAM and sampling at the receiver, 
whereas FDM does the same thing in the frequency domain with AM (or FM), 
bandpass filters, and demodulation. 

An FDM system for DSB-AM/SC signals is shown in Figure 16.20. 

The individual input signals are allocated distinct segments of the frequency 
band. To recover the individual channels in the demultiplexing process requires 
two steps (see Figure 16.21): 

1 . Bandpass filtering to extract the modulated signal of interest in the band 

r CO -CO.,, CO +CO., 1 

L Cl M 9 Cl M J 

2. Synchronous or asynchronous demodulation to recover the original signal 
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FIGURE 16.20 Frequency-division multiplexing of two signals. 



cos OJ c2 t 

demultiplexing demodulation 


FIGURE 16.21 Demultiplexing and demodulation of an FDM signal. 


In a simple AM radio receiver such as the one in Figure 16.22, there is only one 
bandpass filter at a fixed intermediate frequency ( 0 IF . Two copies of the spectrum 
of the received FDM signal w(t) are shifted to (Q ci + 0 )„ and to -co ci - co IF so that the 
spectrum of the desired radio station is aligned with the bandpass filter. This 
process is called the superheterodyne receiver. It avoids the use of a complex, ex- 
pensive tunable bandpass filter. An envelope detector (or a synchronous demodu- 
lator) does the rest. 

Note that the envelope detector also does not have to be tunable. Rather, it is 
designed to be optimal for the intermediate frequency. Also note that in practice 
there would normally be a coarse tunable filter applied on w(t) before the super- 
heterodyning operation to remove the possibility of spectral overlaps. 
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FIGURE 16.22 Superheterodyne AM receiver. 


For the above example with two signals (radio stations) and the tuner set to re- 
ceive station 1, the spectra would be as shown in Figure 16.23. 


W(ja) 



FIGURE 16.23 Tuning the superheterodyne AM receiver to receive signal 1. 


ANGLE MODULATION 


Instead of modulating the amplitude of the carrier, it is often preferable to modu- 
late its frequency or phase. This section is a brief overview of angle modulation, 
encompassing these two techniques. Define the instantaneous frequency (oft) as 
the derivative of the angle of the carrier c(t) = cos (Q(t)). 
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7< m 

(16.43) 

The integral form is 


t 

0(0 = J (O.(T)dT. 

(16.44) 

In amplitude modulation, we have 0(0 = 0 ) t and £0 (0 = Q) c . Note that angle 
modulation is difficult to analyze in the frequency domain, so this is outside of the 
scope of this book. 

Frequency Modulation 

In frequency modulation, the instantaneous modulation frequency is set to 

co i (t) = co c + k f x(t), 

(16.45) 

so that 


t 

0(0 = £ ot + k f J x(z)dz, 

(16.46) 

and the frequency modulated signal is given by 


( ' 'l 

y(t) = Acos (Ot + k f J x(z)dz 

V / 

(16.47) 

Note that its amplitude is constant. 


Phase Modulation 


In phase modulation, the angle is set to 


0(t) = (O c t + k f x(z), 

(16.48) 

and the phase modulated signal is given by 
y(t) = Acos^coj + k f x(t )j. 

(16.49) 
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Demodulation of FM Signals: The Discriminator and the Phase-Lock Loop 

Demodulation of angle-modulated signals can be carried out using a discrimi- 
nator, which is composed of a differentiator followed by an envelope detector, as 
shown in Figure 16.24. 
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FIGURE 16.24 Discriminator for demodulation of 
FM signals. 


At the output of the differentiator, signal w(t) = -A[co c + k f x(t )] 



is essentially an AM signal because the frequency of the FM 


“sine” wave (acting as a carrier) is much higher than the bandwidth of the modu- 
lating signal. Therefore, an envelope detector will generate z(t) = A[co c + k f x(t)], a 
scaled version of the modulating signal. 

Demodulation of angle-modulated signals can also be carried out more effi- 
ciently using a system called a phase-lock loop (PLL). This is a feedback control 
system that tracks the frequency of the modulated signal by reducing the phase 
error between the modulated signal and a sinusoid generated by a local oscillator. 
A block diagram of a typical phase-lock loop is shown in Figure 16.25. 


y{t) 



FIGURE 16.25 Phase-lock loop. 


The voltage controlled oscillator (VCO) outputs a sine wave y(t) with a fre- 
quency proportional to its input voltage. If this frequency is below the frequency of 
the FM signal, the phase difference between y(t) and y(t) will increase linearly, 
causing the output of the controller to increase the VCO frequency until it “locks” 
on the FM signal’s frequency. 
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Let us analyze a basic implementation of the phase-lock loop. An important as- 
sumption is that the frequencies, and furthermore the angles, of the modulated sig- 
nal and the sinusoid at the output of the VCO are very close. The phase comparator 
can be implemented by multiplying the signals y(t) and y(t) . 


y(t)y(t ) = A cos 


A . 

= — sin 
2 


co 


t + k f j x(z)dz sin(® c t + 0(0) 


v 


j 


6(t ) - k f J x{z)dz + ^-sin 2(O c t + 9(t) + k f j x(z)dz 


( 


(16.50) 


V 


To first order, the first term is proportional to the phase difference. The second 
term is at twice the carrier frequency and can easily be removed by a lowpass fil- 
ter (with a gain of-1 to get negative feedback.) The resulting phase error signal is 
then: 



( ‘ ^ 

9(t)-k f | x(z)dz 

v -» y 


a( ‘ ' 

s— k f . J x(z)dz — 6(t) 

2 l - V 


(to first order). 


(16.51) 


A block diagram of the phase comparator is shown in Figure 16.26. 
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FIGURE 16.26 Phase comparator. 


The PLL is in phase lock when the error is equal to zero, that is, when 

t 

G(t ) = r(t) := k f J x(z)dz. In this case, the instantaneous frequency of the output 
of the VCO y(t) is given by 

m vco ■= j[ m c t + 0(0] = 6> c + k f x(t). 


(16.52) 
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Generally, a VCO produces an instantaneous frequency that is proportional to 
its input voltage, which we denoted as x(t). Here, we assume that for a zero input 
voltage, the VCO oscillates at frequency co c . 

® ^ ® + kyco*( 0 ( 16 ‘ 53 ) 

Therefore, the phase of the VCO is the integral of its input voltage: 

t 

e(t) = k VC0 \x(T)dT. (16.54) 


The PLL can now be analyzed as a linear time-invariant (LTI) feedback con- 
trol system with the block diagram in Figure 16.27, where the controller block is 
an LTI controller with transfer function K(s), and its output x(t) is the signal that 
should be proportional to the message signal x(t). 



FIGURE 16.27 LTI feedback control model of PLL. 


Recall from Chapter 1 1 that the closed-loop transmission of this feedback 
tracking system can be computed as follows: 




».) K(s)k T 

HS) l+ATW^ 


(16.55) 


Assuming that K(s ) -k is a pure gain controller, we obtain what is called a PLL 
of order 1, whose transmission is 


kk 

T(s)= vco 


1 


s + kk, 


(16.56) 


vco 


kk, 


-5 + 1 


vco 
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The DC gain of this closed-loop transfer function is 1 , which represents near- 
perfect tracking of the phase of the FM signal when it changes slowly. The magni- 
tude of the Bode plot of T(s) stays close to 1 (0 dB) up until the break frequency 
(O 0 = kk va) . This frequency must be made higher than the bandwidth of the refer- 
ence signal, which is essentially the bandwidth of the message signal (modulo the 
l/ j(0 effect of integration), by selecting the controller gain k appropriately. Also 
recall that the linear approximation of the sine function of the phase error holds for 
small angles only. This is another important consideration to keep in mind in the 
design of K(s), as the PLL could “unlock” if the error becomes too large. 

Finally, the message-bearing signal of interest in the PLL is the output of the 
controller, which is given by 

*0) = ^ ^ f(s) = y p Hs). (16.57) 

Y | /- VcO S + KK vco K vco l y _|_ I 


d 

Thus, signal x(t) is a filtered version of dj r(t) = — x(t), where the deriva- 
tive comes from the numerator s, but the effect of the first-order lowpass filter 
1 can be neglected if the controller gain k is chosen high enough, which 

5+1 

kkyco 

pushes the cutoff frequency outside of the bandwidth of the message 
signal. Therefore, with a large controller gain, the first-order PLL effectively de- 
modulates the FM signal by giving the voltage signal: 


x(t) = 


-x(t). 


(16.58) 


SUMMARY 


This chapter was a brief introduction to the theory of communication systems. 

■ Amplitude modulation of a message signal is obtained by multiplying the sig- 
nal with a sinusoidal carrier. This shifts the spectrum of the message and re- 
centers it around the carrier frequency. The AM signal can be demodulated by 
a synchronous demodulator whose frequency must be made equal to the carrier 
frequency, or by a simpler asynchronous demodulator essentially consisting of 
an envelope detector. 
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■ Many AM signals can be transmitted over the same channel using frequency 
division multiplexing. 

■ We discussed pulse-train modulation and pulse-amplitude modulation for 
transmitting sampled signals. Time-division multiplexing can be used to trans- 
mit many PAM signals at the same time, but intersymbol interference can be- 
come a problem if the pulses are not sufficiently bandlimited. 

■ Angle modulation was discussed with an emphasis on frequency modulation. 
The basic discriminator and phase-lock loop were analyzed as two possible de- 
modulators of FM signals. 


TO PROBE FURTHER 


For a more complete introduction to communication systems, see Roden, 1995 and 
Flaykin, 2000. 


EXERCISES 

Exercises with Solutions 

Exercise 16.1 

Consider the DSB-AM/WC signal: 

y(t) = [1 + 0.2x(t)]cos(27rl0 5 t), 
where the periodic modulating signal is x(t) = |sin( 1 OOOzrr ) 


(a) Sketch the modulating signal x(t) and the spectrum of the modulated 
signal Y(jco). 


Answer: 

The modulating signal x(t) sketched in Figure 16.28 is a full- wave rectified sine 


wave. 
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FIGURE 16.28 Modulating signal of Exercise 16.1. 


Let 7) = 0.001 be the fundamental period of the signal x(t), let 0 ) ] = 2k j 7) be 

its fundamental frequency, and co Q = 1 ()()() k = 0.5(1^ be the fundamental frequency 
of sin( 10007ft). The spectrum of the modulated signal is obtained by first comput- 
ing the Fourier series coefficients of the message signal: 


a k = y jv(t)e Jkc °''dt 


i o 

r, 


i i 

= — Jsin ((O 0 t)e~ jkw '' dt 


i o 


T i 

= — J (e ,f ' v - e-^y-^'dt 


W i o 

n 

= -L 

2 JT. J 


1 0 


e jco 0 (\-2k)t __ e -jm a (\+2k)t 


dt 


CO Q -2 2 

2nj jco 0 (\-2k) jco Q (\ + 2k) 
2 

n(\-4k 2 )' 


Thus, the spcctnnu X( j'o)) is given by 

+oo 

X(jco) = 2 a k S(co - hco x ) 


k=-oc 


=s 


— —8{(o-k2000n) 
*~(l-4£ 2 ) 
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and the spectrum of the modulated signal is found to be 

+03 r\ +oo r\ 

Y(jco)= y -8{a>- 2000007T - klOOOn) + Y —S(w + 20000071 -Jc2000k) 

*fi(l-4k 2 ) *ft(l-4k 2 ) 

This spectrum is sketched in Figure 16.29. 


Y(ja>) 
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FIGURE 16.29 Spectrum of modulated signal of Exercise 16.1. 


(b) Design an envelope detector to demodulate the AM signal. That is, draw a 
circuit diagram of the envelope detector and compute the values of the cir- 
cuit components. Justify all of your approximations and assumptions. Pro- 
vide rough sketches of the carrier signal, the modulated signal, and the 
signal at the output of the detector. What is the modulation index m of the 
AM signal? 


Answer: 

An envelope detector can be implemented with the simple RC circuit with a diode 
shown in Figure 16.30. 


O 

+ 


y(t) 



FIGURE 16.30 Envelope detector 
in Exercise 16.1. 
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The output voltage of the detector, when it goes from one peak at voltage Vj to 
the next when it intersects the modulated carrier at voltage v 2 after approximately 

one period T= 1 0 us of the carrier, is given by v 2 = v ] e~ TIRC . Since the time con- 
stant r = RC of the detector should be large with respect to T= 10 /us, we can use 
a first-order approximation of the exponential such that v 2 = v t (l - T / RC). This is 

V 

a line of negative slope between the initial voltage Vj and the final voltage 
v 2 so that 


v,-v. 


L =-vjRC. 


This slope must be “more negative” than the maximum negative slope of the 
envelope of v,; thus we have to solve the following minimization problem: 

. d( 0.2 sin( IOOO tt?)) ... 

mm — = -200 tt. 

t dt 


Taking the worst-case v t = 1, we must have 


1_ 

~~RC 
<=> 


< -200tt 


RC< 


200k 


= 0.00159. 


We could take R = 1 kQ, C = 1 to get RC = 0.001s. 

Let K be the maximum amplitude of 0.2 x(t), that is, |0.2x( t )| < 0.2 = K, and let 

A = 1. The modulation index m is computed as m = K/ A = 0.2. 


Exercise 16.2 

The system shown in Figure 16.31 demodulates the noisy modulated continuous- 
time signal y n {t) = y( t) + n( t) composed of the sum of 

■ Signal y(t) which is a lower SSB-AM/SC of x(t) (assume a magnitude of half 
that of X{jco)) 

■ A noise signal n(t) 
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FIGURE 16.31 Discrete-time SSB-AM demodulator in Exercise 16.2. 


The carrier signal is cos(O) t), where 0 ) = IOOOOOtt rad/s. The antialiasing 
filter H a ( jco ) is a perfect unity-gain lowpass filter with cutoff frequency co a . 

The modulating signal x(t) has a triangular spectrum X( j'o)) as shown in Figure 
16.32. The spectrum N(jco) of the noise signal is also shown in Figure 16.32. 


/ 

‘ X(ja>) 


— 2000 * 

200071 

k N{j(o) 
1 

_[ 



-20000071 -10000071 

10000071 20000071 > {0 

FIGURE 16.32 Fourier transforms of signal and noise in Exercise 1 6.2. 


(a) Find the minimum antialiasing filter’s cutoff frequency (O a that will avoid 
any unrepairable distortion of the modulated signals due to the additive 
noise n(t). Sketch the spectra Y n (jco) and W(jco) of signals y n (t) and w(t) 
for the frequency co a that you found. Indicate the important frequencies and 
magnitudes on your sketch. 


Answer: 

Minimum cutoff frequency of antialiasing filter: (Q a = 1 00,000/r rad/s The spectra 
Y n (jco) and W(jco) are sketched in Figure 16.33. 
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-980 OOn 98000* 

FIGURE 16.33 Fourier transforms of signal and noise in Exercise 16.2. 

(b) Find the minimum sampling frequency (0 = 2 * and its corresponding 
sampling period T s that would allow perfect reconstruction of the modu- 
lated signal. Give the corresponding cutoff frequency 12, of the perfect 
unity-gain lowpass filter and the demodulation frequency Q c . (What does 
the discrete-time synchronous demodulation amount to here?) Using these 
frequencies, sketch the spectra W d (e ,il ), V d (e' il ), X d (e jil ). 

Answer: 2^- j 

Sampling frequency: co =2 co = 200000n rad/s, T = — = = 1 0 5 s 

F 5 4 3 s co 100000 

S 

Demodulation frequency: = n. The synchronous demodulation amounts to 

multiplying the signal by (-1)". 

Cutoff frequencies: Qj = 2000^7 = 0.02 tt. The DTFTs W d (e jn ),V d (e JQ ), 

X d (e jn ) are shown in Figure 16.34. 


n 

K,(X 1 ) = A'aXO 

n 

FIGURE 16.34 Fourier transforms of signal and noise in Exercise 1 6.2. 
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Exercise 16.3 

You have to design an upper SSB amplitude modulator in discrete-time as an im- 
plementation of the continuous-time modulator shown in Figure 16.35. 


COS COj 



sin coj 


cos (Cl c n) 



sin(Q..«) 


FIGURE 16.35 Continuous-time and discrete-time upper SSB-AM 
modulators of Exercise 16.3. 


The modulating signal has the Fourier transform shown in Figure 16.36, and 
the carrier frequency is (O c = 2,000,000 n rad/s (1 MFIz). 



FIGURE 16.36 Spectrum of the 
message signal in Exercise 16.3. 
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Design the modulation system (with ideal components) for the slowest possi- 
ble sampling rate. Find an expression for the ideal discrete-time phase shift filter 
H d (e jU ) and compute its impulse response h d [n\. Explain how you could imple- 
ment an approximation to this ideal filter and describe modifications to the overall 
system so that it would work in practice. 

Answer: 

First, the ideal phase-shift filter should have the following frequency response: 

H(e ^J J. °< a < ,c , 

{-j, - n < Q < 0 

The inverse Fourier transform yields 

h d [n\ = - 1 - J H d (e jS1 ) e jn "d Q = — [l-(-l)"]. 

2n J 71 n 

-n 

To compute the slowest sampling frequency, we start from the desired upper 
SSB-AM signal at the output, whose bandwidth is co = 2,004, 0007T, which 
should correspond to the highest discrete-time frequency Q = n. Thus, we can 

£2 K 

compute the sampling period from the relationship — = <y => = T, which 

T (0 

yields T = 4.99 xl0“ 7 s. 

This system could be implemented in practice using an FIR approximation to 
the ideal phase-shift filter. Starting from h d [n], a windowed impulse response of 
length M+ 1 time-delayed by Ml 2 to make it causal would work. However, the re- 
sulting delay of Ml 2 samples introduced in the lower path of the modulator should 
be balanced out by the introduction of an equivalent delay block z~ Mn in the upper 
path. 

Exercises 

Exercise 16.4 

The superheterodyne receiver in Figure 16.22 consists of taking the product of the 
AM radio signal with a carrier whose frequency is tuned by a variable-frequency 
oscillator. Then, the resulting signal is filtered by a fixed bandpass filter centered 
at the intermediate frequency (IF) co IF . The goal is to have a fixed high-quality fil- 
ter, which is cheaper than a high-quality tunable filter. The output of the IF band- 
pass filter is then demodulated with an oscillator at constant frequency to tune in 
to your favorite radio station. Suppose that the input signal is an AM wave of 
bandwidth 1 0 kHz and carrier frequency C 0 c that may lie anywhere in the range 
0.535 MHz to 1.605 MHz (typical of AM radio broadcasting). Find the range of 
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tuning that must be provided in the local oscillator (O vco in order to achieve this 
requirement. 

Exercise 16.5 

In the operation of the superheterodyne receiver in Figure 16.22, it should be clear 
from Figure 16.23 that even though the receiver is tuned in to station 1, the “ghost” 
spectrum of a radio station at a carrier frequency higher than ft) , could appear in 
the passband of the IF bandpass filter if an additional filter is not implemented. De- 
termine that ghost carrier frequency. 


Answer: 



ON THE CD 


Exercise 16.6 

Design an envelope detector to demodulate the AM signal 
y(t) = [1 + 0.4x(t)]cos(27rl0 3 0, 

where x(t) is the periodic modulating signal shown in Figure 16.37. That is, draw 
a circuit diagram of the envelope detector and compute the values of the circuit 
components. Justify all of your approximations and assumptions. Provide rough 
sketches of the carrier signal, the modulated signal, and the signal at the output of 
the detector. What is the modulation index m of the AM signal? 



Exercise 16.7 

The sampled-data system shown in Figure 16.38 provides amplitude modulation of 

+oo 

the continuous-time signal x(t). The impulse train signal is p[n\ = ^ 8[n-kN\ 

k=- oo 
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n{t) 


*n(t) 

\ h 

H a i.jco) 

w(t) 

CT/DT ' 
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+ 
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► 

) 




k 




FIGURE 16.38 Modulation system in Exercise 16.7. 


The antialiasing filter H a (jco) is an ideal unity-gain lowpass filter with cutoff 
frequency (O n , and the perfect discrete-time highpass filter H hp (e jn ) has gain N 
(which is also the period of p[n ]) and cutoff frequency Q, = 0.6tt. 

The modulating (or message) signal x(t) has spectrum X( / 0 )) as shown in Fig- 
ure 16.39. The spectrum of the noise signal N(jco) is also shown in the figure. 




, N(jco) 

l 



-20000n -200 Ott 

200071 2000071 0 


FIGURE 16.39 Fourier transforms of signal and noise in Exercise 1 6.5. 


(a) Find the minimum antialiasing filter’s cutoff frequency (O a that will avoid 
any unrepairable distortion of the signal x(t) due to the additive noise n(t). 
Sketch the spectra X n (j(d) and W( jco) of signals x„(t) and w(t) for the fre- 
quency co a that you found. Indicate the important frequencies and magni- 
tudes on your sketches. 

J 2 n 

(b) Find the minimum sampling frequency = — and its corresponding 

5 

sampling period T s that would allow amplitude modulation of the signal 
x(t) at a carrier frequency of 0 ) = SOOOzr rad/s. Find the corresponding 
discrete-time sampling period N of p[n\ for the system to work. Using 
these frequencies, sketch the spectra W d (e ' n ), V d (e jn ), Y d (e jn ) and Y{jco). 
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Answer: 

G C 

ON THE CD 

Exercise 16.8 

The system shown in Figure 16.40 is a lower single-sideband, suppressed-carrier 
AM modulator implemented in discrete time. The message signal x(t) is corrupted 
by an additive noise n(t): x„(t) = x(t) + n(t ) before sampling. We want the modula- 
tor to operate at a carrier frequency co = 2k x 10 6 rad/s (1 MFIz). 



FIGURE 16.40 Discrete-time SSB modulator of Exercise 16.8. 


The antialiasing filter H a (jco) is a perfect unity-gain lowpass filter with cutoff 
frequency co a . The antialiased signal w( t) is first converted to a discrete-time signal 
w d [n] via the CT/DT operator. Signal w d [n] is modulated with frequency il, and 
bandpass filtered by H bp (e jn ) to create the lower sidebands. Finally, the DT/CT 
operator produces the continuous-time lower SSB/SC AM signal y(t). 

The Fourier transforms of the modulating signal x(t) and the noise X( jo)) and 
N(jco) are shown in Figure 16.41. 

(a) The antialiasing filter’s cutoff frequency is given as (O a = 3000k. Sketch 
the spectra X n ( jco) and W( j( 0 ) of signals xjt) and w( t). Indicate the im- 
portant frequencies and magnitudes on your sketch. 

(b) Find the minimum sampling frequency a \ and corresponding sampling 
period T s that will produce the required modulated signal. Find the dis- 
crete-time modulation frequency Q c that will result in a continuous-time 
carrier frequency (O c = 2n x\0 rad/s. Give the cutoff frequencies 12, < Q 2 
of the bandpass filter to obtain a lower SSB-AM/SC signal. Using these 
frequencies, sketch the spectra W d (e ,n ), V d (e /Q ), Y d (e jn ) and Y( ja>). 







61 6 Fundamentals of Signals and Systems 



FIGURE 16.41 Fourier transforms of signal and noise in Exercise 16.8. 


Exercise 16.9 

A DSB/SC AM signal XO is generated with a carrier signal c tmnsm (t) = cos (co j). 
Suppose that the oscillator of the synchronous AM demodulator at the receiver in 
Figure 16.42 is slightly off: 

c rec (t) = cos((CQ c + A)t). 



FIGURE 16.42 Synchronous demodulator 
at the receiver in Exercise 1 6.9. 


(a) Denoting the modulating signal as x{t), write the expression for w(t), and 
for z(t) after perfect unity-magnitude lowpass filtering with cutoff at co c . 

(b) Let (o = 2 tt10 6 , A = 2tt 10 3 rad/s. Plot z(t) for the modulating signal 
x(t ) = sin( 20000^?). 

Answer: 


ON THE CD 




System Discretization and 
Discrete-Time LTI 
State-Space Models 


In This Chapter 

■ Controllable Canonical Form 
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■ Zero-State and Zero-Input Responses of a Discrete-Time 
State-Space System 

■ z-Transform Solution of Discrete-Time State-Space Systems 

■ Discretization of Continuous-Time Systems 

■ Summary 

■ To Probe Further 

■ Exercises 



((Lecture 68: State Models of LTI Difference Systems)) 


I n this last chapter, causal discrete-time state-space models of linear time-in- 
variant (LTI) systems are introduced mainly as a means of providing methods 
to discretize continuous-time LTI systems. The topic of system discretization is 
an important one for at least two reasons. First, engineers often need to simulate the 
behavior of continuous-time systems, and analytical solutions can be very difficult 
to obtain for systems of order three or more. Second, many filter design and con- 
troller design techniques have been developed in continuous time. Discretizing the 
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resulting system often yields a sampled-data implementation that performs just as 
well as the intended continuous-time design. 

Of course, discrete-time LTI (DLTI) state-space models are of interest in their 
own right, particularly in advanced multivariable discrete-time filter design and 
controller design techniques, which are beyond the scope of this textbook. An im- 
portant word on notation before we move on: for discrete-time state-space systems, 
the input signal is conventionally written as u[n ] (not to be confused with the unit 
step) instead of x\n\, as the latter is used for the vector of state variables. Hence, in 
this chapter we will use q[n ] to denote the unit step signal. 


CONTROLLABLE CANONICAL FORM 


In general, an iW-order linear constant-coefficient causal difference equation with 
M<N has the form 

N M 

^ I a k y[n-k\ = ^ j b k x[n-k], (17.1) 

which can be expanded into 

a Q y\n] + a { y\n — 1] H F a N y\n- N] = b Q x[n] + b { x[n - 1] H 1 - b M x[n- M], (17.2) 

Just like the continuous-time case, we can derive a state-space model for this 
system by first finding its controllable canonical form (direct form) realization. We 
take the intermediate variable w\n\ and its successive N — 1 delayed versions as 
state variables. Let a Q = 1 without loss of generality. Taking the z- transform on 
both sides of the difference Equation 1 7. 1 , we obtain the transfer function (with re- 
gion of convergence [ROC] the exterior of a disk of radius equal to the magnitude 
of the outermost pole): 


M 


H{z) = 


Y(z) 

U(z) 


IK 

k=0 


-k 


a,z 

i k 


-k 


b 0 + b l Z 


k=0 

-1 


. 7 -M + 1 . 7 -M 

+ b M- 1 Z +V 


1 + a,z H 1- a„, ,z N+l +a„z N 


N-l 


(17.3) 
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A direct form can be obtained by considering the transfer function H (z) as a 
cascade of two subsystems as shown in Figure 17.1. 

The input-output system equation of the first subsystem is 



FIGURE 17.1 Discrete-time transfer function as cascade of two LTI systems. 


W(z) = -a l z l W(z) <Tv_i z N+1 W(z)- a N z N W(z) + U(z). 

For the second subsystem we have 



FIGURE 17.2 Direct form realization of a discrete-time transfer function. 


Y(z) = b 0 W(z) + bf'Wiz) + • ■ ■ + b Ml z~ M+l W (z) + b M z~ u W(z). (17.5) 

The direct form realization is shown in Figure 17.2, where it is assumed that 
M= N without loss of generality. 
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r i n 

From this block diagram, define the state variables |jc.J as follows. 

X x (z):= z~ N W(z) x^n + \\ = x 2 \n\ 

X 2 (z):=z~ n+x W(z) x 2 [n + l\ = x 3 [n] 


X N _ x (z):=z 2 W(z) x n _ 1 [« + l] = x Ar [n] 

X N (z) := z~ l W (z) x N \n + 1] = -a ] x N [n\ - a 2 x N _ 1 [«] a N x x [»] + u[n] (17.6) 


The state equations on the right can be rewritten in vector form: 


Xj[n + 1] 


0 

i 

0 

0 " 

x x [n\ 


"o" 

x,[« + 1] 


0 

0 

0 

0 

x 2 [n\ 


0 


= 






+ 


x N _ x [n + \\ 


0 

0 

0 

1 

x N _ x [n\ 


0 

x N [n + 1] _ 


r a N 

~ a N- 1 

—Cl 2 

—a { 

1 

| S | 


1 


A B 


u[n\. 


(17.7) 


Let the state vector (or state) be defined as 


x[«] := 


x x [n] 

x 2 [n] 


x N -i [«] 
x N [n] 


(17.8) 


Then the state equation (Equation 17.7) can be written as 

x[n + 1] = Ax[n] + Bu[n] (17.9) 

From the block diagram in Figure 17.2, the output equation relating the output 
y{n\ to the state vector can be written as follows. 


y[n] = [b N -a N b Q b N _ x -a N _ x b Q 

v v 

C 


••• b x - a x b 0 ~^x[n] + b Q u[n] 
£> 


(17.10) 


= Cx[n] + Du[n] 
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If H(z) is strictly proper as a rational function of z, that is, the order of the nu- 
merator is less than the order of the denominator, then the output equation becomes 

y[n] = Cx[n] (17.11) 

Note that the input has no direct path to the output in this case, as D = b Q = 0. 


OBSERVABLE CANONICAL FORM 


We now derive an observable canonical state-space realization for the system of 
Equation 17.1. Assume without loss of generality that M- N. First, let us rewrite 
the transfer function H(z) of Equation 17.3 for convenience: 


H(z) = 


VV -E-. + Vi z-^ 

1 . -1 . , -N + 1 

1 + flz H 1- a NX z 


+V 


-N 


+ a N z 


-N 


(17.12) 


Then, the input-output relationship between U(z) and Y(z ) can be written as 

Y(z) = b 0 U(z ) + (b i U(z) - fljT(z))z _1 + (b 2 U(z) - a 2 Y(z))z~ 2 + • • • + (b N U(z) - a N Y{z))z~ N (17.13) 

The block diagram of Figure 17.3 for the observable canonical form consists of 
a chain of A unit delays with a summing junction at the input of each. 






FIGURE 17.3 Observable canonical form realization of a discrete-time transfer 
function. 
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The state variables are defined as the outputs of the unit delays, which gives us: 


=X, 00 = -a N X N (z) + (b N - a N b 0 )U (z) x x [n + 1] = -a N x N [n] + (b N - a N b 0 )u[n] 

zx 2 (z) = x x (z)~ a N _,X N (z) + (Vi - a N _f)U(z ) x 2 [n + 1] = x x [n\ - a^x^n] + ( Vi - a N ^ )u[ri\ 

zX 2 (z) = X 2 (z)— a N 2 X N (z) + (b N 2 — d N 2 b 0 )U(z) => x 2 [n + \\ = x 2 [n}-a N 2 x N [n] + (b N 2 -a N _ 2 b 0 )u[n}. 

=X N (z) = X N _ 1 (z)-a i X N (z) +(b 1 - a,t > 0 )U (z) x N [n + 1] = x N _ 2 [n\ - a l x N [n] + (fy - a,6 0 )w[n] 


The state equations on the right can be rewritten in vector form: 
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xfn\ 


b N 

- a N b Q 
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x 2 [n] 
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~ a N-l b 0 

x N _fn + l] 
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-a 2 



b 2 
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_ x N [n + 1] _ 
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■ 1 

-a x 
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b l 
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1 


A B 


(17.15) 


Again this state equation can be written as in Equation 17.9. From the block di- 
agram in Figure 17.3, the output equation relating the output y[«] to the state vec- 
tor can be written as follows. 


y[«] = [~0 0 0 llx[«] + h 0 «[i7] 

t v d 1 — v — 1 

C D 

= Cx[n ] + Du[n] 


(17.16) 



((Lecture 69: Zero-State and Zero-Input Responses of Discrete-Time State 
Models)) 


ZERO-STATE AND ZERO-INPUT RESPONSES OF A DISCRETE- 
TIME STATE-SPACE SYSTEM 


Recall that the response of a causal FTI difference system with nonzero initial 
conditions is composed of a zero-state response due to the input signal only and a 
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zero-input response due to the initial conditions only. For a discrete-time state- 
space system, the initial conditions are captured in the initial state x[ 0]. 

Zero-Input Response 

The zero-input response of a state-space system is the response to a nonzero initial 
state only. Consider the following general state-space system: 

x[n + 1] = Ax[n\ + Bu[n], (17.17) 

y\n\ = Cx\n\ + Du[n ] 

where (the values, not the signals) x[«]eR ;v , v[n]eK, w[«]eR and 
A e R NxN , B g R^* 1 , C g R 1x7V , D g R, with initial state x[0]^0 and input 
u[n\ = 0. Let the unit step signal be denoted as q[n\. A solution can be readily ob- 
tained recursively: 


x[l] = Ax[ 0] 

T z ,[0] = Cx[0] 
x[2] = A 2 x[ 0] 
y z .[0] = CAx[0] 

x[3] = A 3 x[ 0] 

y zi [2] = C4 2 x[0] 

x[« + l] = A" +1 x[0] 

y zi [n\ = CA n x[ 0], (17.18) 


Lienee, the zero-input response is T., [«] = C4"x[0]^[«], and the corresponding 
state response is x[n] = A n x[0]q[n]. 

Zero-State Response 

The zero-state response [n] is the response of the system to the input only (zero 
initial conditions). A recursive solution yields 
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jc[0] = 0 
*,[-!] = 0 
x[l\ = 5m[0] 

TjO] = Du[0] 
x[2] = ABu[ 0] + Bu\Y\ 
y zs [\] = CBu[0]+Du[\] 
x[3] = A 2 Bu[ 0] + ABu[ 1] + Bu[ 2] 
y vs [2 \ = CA Sm[0] + CBu\Y\ + Du[ 2] 

x[n + 1] = A n Bu[ 0] + A"~ l Bu[ 1] H 1- - 1] + 5w[»] 

= C4" _1 5m[0] + CA n ~ 2 Bu[ 1] + • ■ ■ + - 1] + £>«[«]. (17. 19) 

These last two equations look like convolutions, and indeed they are. The 
impulse response of the state-space system of Equation 1 7. 1 7 is obtained by setting 
u[n] = 8[n\ with a zero initial state. 

x[n + 1] = Ax[n ] + Bd[n ] 

y[n] = Cx[n] + D8[n] (17.20) 

The recursive solution for the impulse response yields 

*[1] = B 
h[ 0] = D 
x[2] = AB 
h[ 1] = CB 
x[3 ] = A 2 B 
h[ 2] = CAB 

x[n + 1] = A n B 
h[n ] = CA"^B. 


(17.21) 
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Thus, the impulse response of the system is given by 

h[n\=CA n -'Bq[n-\\ + DS[n\. (17.22) 

State-space systems are not different from other LTI systems, in that the zero- 
state response of an LTI state-space system is the convolution of the impulse re- 
sponse with the input. Assume that the input is zero at negative times, then 

y, s \ n \ = h[n] * u[n\ = CA" l Bq[n - 1] * u[n\ + D8[n\ * u[n ] 

+QQ 

= ^ CA k ~ l Bq[k-l]u[n- k] + Du[n\ 

k=-°° 

n 

= ^ j CA kl Bu\n - k] + Du[n\. (17.23) 

k = 1 


This last expression for the zero-state response is the same as the last equality 
in Equation 17.19. Finally, the overall response of a causal DLTI state-space sys- 
tem is the combination of the zero-state and the zero-input response: 


y[n] = y.[n\ + yjn] 


= CA n x[0]q\n\ + 


^ CA k ~ l Bu[n - k] 

\ k = 1 


q[n-\] + Du[n\. 


(17.24) 


Z-TRANSFORM SOLUTION OF DISCRETE-TIIVIE 
STATE-SPACE SYSTEMS 


Consider the general LTI discrete-time state-space system: 

x[n + 1] = Ax[n\ + Bu[n ] 

y[ri\ = Cx\n\ + Du[n\, (17.25) 

where x[n\ e y[n] e R, u[n] e R and A e R NxN , B e R Nx \ C e M lxW , D e R, 
with initial state x[0] = x . Taking the unilateral z- transform on both sides of Equa- 
tion 17.25, we obtain 
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z'X(z)-zx Q = AX(z) + BVt(z) 
ty(z) = C'X(z)+D7l(z). 


(17.26) 


Solving for the z-transfomi of the state in Equation 17.26, we get 

n.z) = ( zl n - Ay l B?i{z) + z(zI n - A)-\, (17.27) 

and the z-transform of the output is 

%(z) = [ C(zl n - AT 1 B + D\K(z) + zC(zI n - Af l x 0 . (17.28) 

The first term on the right-hand side of Equation 17.28 is the z-transform of the 
zero-state response of the system to the input u[n], whereas the second term is the 
z-transform of the zero-input response. Thus, the transfer function of the system is 
given by: 

^( z ) = l^l = C(z7 -Af l B + D. (17.29) 

Note that we have not specified an ROC yet. First, we need a result relating the 
eigenvalues of matrix A to the poles of the transfer function. 

Bounded-Input Bounded-Output Stability 

Minimal state-space realizations are realizations for which all N eigenvalues of A 
appear as poles in the transfer function given by Equation 17.29 with their multi- 
plicity. In other words, minimal state-space realizations are those realizations for 
which the order of the transfer function as obtained from Equation 17.29 is the 
same as the dimension N of the state. 

Fact: For a minimal state-space realization ( A,B,C,D) of a system with trans- 
fer function H(z) the set of poles of H(z) is equal to the set of eigenvalues of A. 

Since we limit our analysis to minimal state-space realizations, this fact yields 
the following stability theorem for DLTI state-space systems. 

Stability theorem: The minimal causal DLTI state-space system ( A,B,C,D ), 
where A e M. NxN , B e R^ xl , C e M lxiV , D el is bounded-input, 
bounded-output (BIBO) stable if and only if all eigenvalues of A have a magnitude 
less than one. Mathematically: ( A,B,C,D ) is BIBO stable if and only if 
\XfA)\<l,\/i = l,...,N. 

Furthermore, since the eigenvalues of A are equal to the poles of H(z) the ROC 
of the transfer function in Equation 17.29 is the exterior of a disk of radius 
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H(z) 


p := max A.(H) . This radius is called the spectral radius of the matrix A, denoted 
as p(A). 

We found earlier that the impulse response of the system in Equation 17.25 is 
given by h[n\ = CA" l Bq[n - 1] + DS[n\. Hence, by identification with Equation 

17.29, the inverse z-transform of (zI N - A) -1 , |z| > p(A) must be A" l q[n- 1], 
which is indeed the case. (Show it as an exercise using a power series expansion 
of the matrix function (zI N - A ) _1 , z > p{A).) That is, we have 

A n -'q[n - 1] 5 (zI N - A)~\\z\ > p(A). (17.30) 

Example 17.1: Let us find the transfer function of the causal system described by 


x[n + 1] = 


" 0.8286 -0.2143" 

x\n\ + 

" 2 " 

-0.1429 0.4714 _ 

-1 

-1 3]x[«] + 2u[n]. 




u[n\ 


(17.31) 


First, we compute the eigenvalues of the A matrix to obtain A, = 0.4, A 2 = 0.9. 
Therefore, the spectral radius of the matrix is p(A) = 0.9 and the ROC should 
contain |z > 0.9 (or be equal to it if the realization is found to be minimal). We use 
Equation 17.29 to calculate H(z). 


=[-l 3] 


z- 0.8286 0.2143 

0.1429 z-0.4714 

1 


(z-0.8286)(z-0.4714)-0.1429'0.2143 


+ 2, |z|>0.9 
[-1 3 ] 


"z-0.4714 

-0.2143 " 

" 2 " 

-0.1429 

z-0.8286_ 

-1 


1 


z-1.3:+ 0.36 


"-1 3" 


2z- 0.7285 
-Z + 0.5428 


+ 2 = 


2z - 7.6z + 3.0769 _ z 2 - 3.8z ^ + 1 .5385 


z -1.3z + 0.36 


z -l.3zH-0.36 


- = 2 


-5z + 2.3569+ 2(z 2 - 1.3z+ 0.36) 
z 2 -1.3z + 0.36 
(z - 0.46 l)(z- 3.339) 


(z-0.4)(z-0.9) 


z >0.9 


+ 2 


(17.32) 


The eigenvalues of the A matrix are the same as the poles of the transfer func- 
tion, and hence the realization is minimal. 
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((Lecture 70: Discretization of Continuous-Time LTI Systems )) 


DISCRETIZATION OF CONTINUOUS-TIME SYSTEMS 


Continuous-time differential systems can be discretized to obtain difference 
equations. This is usually done for simulation purposes, that is, to obtain a numerical 
solution of the differential system’s response. In particular, discretization of a 
continuous-time state-space system ( A,B,C,D ) yields the discrete-time state- 
space system (A d ,B d ,C d ,D d ). 

Discretization Using the Step-Invariant Transformation (c2d operator) 

One way to discretize a continuous-time system is to use the step-invariant trans- 
formation. It consists of a zero-order-hold (ZOH)-like operator at the input of the 
state-space system, which we call DT/ZOH, and a CT/DT operator at its output. A 
block diagram of the step-invariant transformation, also known as the c2d opera- 
tor, is given in Figure 17.4. 



FIGURE 17.4 c2d discretization operator. 

The overall mapping of ( A,B,C,D ) to the discrete-time state-space system 
( A d ,B d ,C d ,D d ) through the step-invariant transformation is called the c2d opera- 
tor in reference to the c2d command in the MATLAB Control Systems Toolbox, 
and we can write 


(A d ,B d ,C d ,D d ) = c2d{(A,B,C,D)}. (17.33) 

The DT/ZOH operator shown in Figure 17.5 is defined as a mapping from a 
discrete-time signal to an impulse train (operator V -1 consisting of forming a train 
of impulses occurring every 7) seconds, with the impulse at time nT s having an area 
u d \n\), followed by a ZOH function that holds each value for a period f- 
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FIGURE 17.5 DT/ZOH operator. 


The CT/DT operator defined in Chapter 15 is shown in Figure 17.6. 


y(t) 

t; 

^ 

IMJ 

1 


tT«] 


CT/DT 





FIGURE 17.6 CT/DT conversion operator. 


It is easy to see why c2d is a step-invariant transformation in Figure 17.4: the 
continuous-time step response y(t) to a step u(t) = q(t) is the same whether the step 
is applied in continuous time, u(t) = q(t), or in discrete time, u d [n ] = q[n\ There- 
fore, the discrete-time step response will be the sampled continuous-time step 
response: y d [n] = y(nT s ). 

Let us have a second look at the matrix exponential e . It is called the state 
transition matrix when it is time shifted to t Q , since for the continuous-time system 
( A,B,C,D ) it takes the state x(t Q ) to the state x(t) for t > t () when the input is 
zero: 

x(t) = e Au ,o) x(t 0 ). (17.34) 

The state response of the state-space system ( A,B,C,D) to be discretized is 
given by the combination of the zero-input state response and the zero-state state 
response. 
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x(t) = e AU , ' ,) x(t 0 )+ J e Az Bu(t -z)dz 

l 0 

t 

= e A, ~ ,o) x{t Q ) + J e A(t ~ T) Bu(T)dT (17.35) 


Notice that the input signal u(t) is a “staircase” function, as it is held constant 
between sampling instants. Thus, if we take t Q = kT s and t = (k + 1)7’ in Equation 
17.35, we can write 

(n+l)T 

x((n + l)T) = e AT ’x(nT)+ J e A(Ln+W ’~ T) dT Bu(nT) 

nT s 

(w+1 )T 

= e AT, x{nT s ) + e A( ' n+r>Ts J e~ AT dx Bu(nT^) 

nT 

= e AT ‘x(nT ) - e A(n+l)T ‘ A~ l \ e~ Ar Bu(nT ) 

s L JnT s 

= e AT ’x{nT)~ A~ 1 e A<n+1)T ’ |Y i4(B+I)r * - e ~ Anl * Bu(nT) 

= e AT "x(nT s )- AT X I N -e ATs Bu(nT s ) 

— e^jX(nT s )+ Ad x e AT ’-I N Bu(nT s ). (17.36) 

1C ' v ^ 

d B d 

where we use the fact that A~ l (assuming it exists) commutes with e A{n+1)Ts . If 
we define the discrete-time state x d [n ] := x(nT s ), the last equality in Equation 17.36 
can be rewritten as a discrete-time state equation as follows, while the output equa- 
tion does not change: 


where 


x d [n + 1] = A d x d [n] + B d u d [n\ 
y d [n\ = C d x d [n\ + D d u d [n\, 


(17.37) 
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B d := A- 1 

C d :=C 

D d -=D. 



B 


(17.38) 


Discretization Using the Bilinear Transformation 

The bilinear transformation (also called Tustin’s method) is a mapping from the 
Laplace domain to the z-domain via 


s = 


1_ 

T 


l-z~' 
1 + z _I 


(17.39) 


Example 17.2: Let us discretize the causal first-order lag H(s ) = 


5 + 1 

55+1 


using 


a sampling period of T = 0.1 5 using the bilinear transformation. We have 


HAz) = 


1 + 5 


l + 5s 


1 + 20 


1 — z 
1 + z~ 


s=20 : 


1 +z 1 


1 + 100 


1 — z 

1 + z” 


l + z~‘+20-20z~ 1 
1 + z -1 + 100-100z“ 


21-19z _1 0.2079(1- 0.9048z _1 ) 


101-99z“ 


(l-0.9802z _1 ) 


z >0.9802 


(17.40) 


The DC gain of this discretized system is given by 
H (e J °)= H (11= 21-19 = i = / 7 (/o) and hence both systems have the same 

i x ' 101 99 J 

low-frequency gain. In fact, the bilinear transformation provides a very good ap- 
proximation to the frequency response of the continuous-time transfer function, at 
least up to frequencies close to the Nyquist rate cy /2 , as seen in the Bode plots of- 
Figure 17.7. 
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FIGURE 1 7.7 Bode plots of first-order lag and its bilinear discretization 
up to the Nyquist frequency. 

Remark: Once a system has been discretized, it must be simulated off-line or 
run in real-time at the same sampling frequency as was used in the discretization 
process. Otherwise, the poles and zeros migrate and the correspondence with the 
original continuous-time system is lost. It is a common mistake to only change the 
sampling rate of a sampled-data system while neglecting to replace the discretized 
filter with a new one obtained by discretizing again with the new sampling period. 

The formula in Equation 17.39 comes from the trapezoidal approximation to 
an integral which is s" ] in the Laplace domain. 

Suppose we want to approximate the continuous-time integrator system of 
Figure 17.8. Consider the plot of a signal v(t) to be integrated between 
t 0 = (n - 1)7;, t ] = nTs, as shown in Figure 17.9. 
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v(0 


>■ 



v(t) 


► 


FIGURE 17.8 Integrator system. 



FIGURE 17.9 Trapezoidal approximation to an integral. 


The trapezoidal approximation of the integral system s 1 is given by 


S rj^ 

y(nT)-y((n-l)T)= J v(t)dt = ^[v(nT) + v((n-l)T)], (17.41) 




which in discrete time can be written as (taking the approximation as an equality) 


y d [«] - y d [« - 1] = [■ v d M + v d [«-!]]• 


(17.42) 


In the r- do main, the transfer function of this system is given by — 
( , . -A 2 


1 + z 


-l 


1 T 

Thus, we have - = — 

5 2 


1 + z"' 


V 1 — Z_1 J 


, and Equation 17.39 follows. 


Now, applying this bilinear transformation to the state equation of our continuous- 
time state-space system in the Laplace domain 


sX(s) = AX(s) + BU{s) 
Y(s) = CX(s)+ DU(s), 


(17.43) 
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we obtain 


^\-^X(z)=AX(z) + BU(z) 
T 1 + z 


T T 

(1 - z~ l )X(z) = y (1 + z~ l )AX(z) + y (1 + z^)BU(z). (17.44) 

Note that the following derivation of the formulas in Equation 17.51 is not 
essential. Multiplying Equation 17.44 on both sides by z, we get 


{z-l)X(z) = y (z+ l)AX(z)+ y (z+ l)BU(z) 


f J > 

1 1 

r 7 > 

I„- — A 

N 'y 

V ) 

II 

* 

-*■ A + I„ 

2 N 
\ J 


T T 

X(z) + y BU(z) + y zBU(z) 



( j > 

-1 

( rj, ^ 

T | 

( j \ 

-1 

T 

f T \ 

zX(z) = j 

hr~— A 
N ry 

\ Z ) 


— A + Iv 

{ 2 "J 

x(z)+y 

hr~— A 
N ry 

\ Z ) 

BU(z) + ^-z 

S' 

1 

EJ c. 


BU(z) (17.45) 


In the time domain. 


x[n + 1] = 


T 

— A 
n 2 


V 1 


T 

— 4 + 4 
2 A 


T 

*M + y 


T 

/„ — -A 
N 2 


V 1 


T 

Bu[n\+ y 


f T A " 1 

I.. — -A 

N J 

v z 


Bu[n + 1], (17.46) 


We have to get rid of the last term on the right-hand side in order to obtain the 
usual form of a state-space system. That term is a direct path to the state, and hence 
to the output y[n + 1]. In order to do this, let us define the new state 


x[«] := x\n\ — y 


T 

L, -A 

N t 

V L J 


-1 


Bu[n\. 


(17.47) 


Then, the state equation becomes 
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{ T 

-1 

( T \ 

T 

+1]= 

/„ — ~ A 
N 2 


—a+i„ 

, 2 w 

|*M + y 


\ 


V / 

- 


f T > 

-1 

f T > 

1 T f 


l" 2 J 


—a+i m 

V 2 "J 

-4»] + y 


( T ) 

/„ — ~ A 

l* 2 j 

-1 

f T > 

—a+i m 

V 2 "J 

x[«]+r f j 


( T \ 

f T 


f T 1 

I„-~ A 

-*-A + I„ 

+ /„ 

i„-— A 

n 2 

2 N 

N 

N 2 

V J 

v y 


V / 


T 

T 

T 

~2 J 


t r 

— A+I„ + I — -A 
2 N 2 


Bu[n\ 


I n~~2 A \ Bu W 


(17.48) 


and the output equation is computed as follows: 


y\ri\ = Cx[n\ + -^-C 


= C Jt[w] + 


T 

— -A 

N 9 

v L J 


V 1 


c, 


T 

f 

T 1 

-1 

D + — C 


— A 

5 

2 

N 

2 , 



V 

J 



Bu[n ] + Du[n\ 
u[n\. 


D, 


(17.49) 


Hence, the state-space system discretized using the bilinear transformation is 
given by 


where 


x[n + 1] = A d x[n] + B d u[n ] 
y[n] = C d x[n] + D d u[n], 


(17.50) 


A d '-= 


B , := T 

a s 


/ J \ 

-1 

( T \ 

I..- — A 


h, + ~A 

2 


2 


f T v 2 

L r - — A 

N 9 

V z J 


B 


c d -=c 


D . := D + — C 

d 2 


T 

I N — -A 

V z J 


B. 


(17.51) 


Remark: The MATLAB c2d command with the “tustin” option implements the 

bilinear transformation 
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A 4 = 


B d = 


-1 


T 

I ai - — A 

N r. 

V L J 


( T ^ ^ 

/.. — -A 

N r. 

V L J 


\ 


T 

I N + — A 

k N 2 J 


B 


C=CT 

a s 


f j ^ 1 

L,-^-A 

N 

V L J 


D, = D + —C 

d 2 


T 

h,- — A 
N 2 

V z J 


-l 


B 


( 17 . 52 ) 


with different B d and C d matrices from those given in Equation 17.5 1 but yield- 
ing the same transfer function as the state-space realization. Either realization can 
be used. 


SUMMARY 


This chapter introduced discrete-time state-space LTI systems and the discretiza- 
tion of continuous-time systems. 

■ Difference LTI systems represented by proper rational transfer functions can 
be realized as state-space systems. We gave procedures to compute the con- 
trollable and the observable canonical realizations, but just like the continuous- 
time case, there exist infinitely many realizations of any given proper rational 
transfer function. 

■ We derived the formulas for the zero-input and zero-state responses, the im- 
pulse response, and the transfer function of a general discrete-time state-space 
system. 

■ A minimal state-space system was shown to be BIBO stable if and only if 
all of the eigenvalues of its A matrix lie in the open unit disk centered at the 
origin. 

■ Two system discretization techniques were derived: the step-invariant trans- 
formation, called c2d, and the bilinear transformation. 
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TO PROBE FURTHER 


Discrete-time state-space systems and discretization are discussed in Chen, 1999. 


EXERCISES 


Exercises with Solutions 

Exercise 17.1 

We want to implement a causal continuous-time LTI Butterworth filter of the sec- 
ond order as a discrete-time system. The transfer function of the Butterworth 

3 — 1 

filter is given by H(s) = _L, 2 +3+i , where co = 2000 n and C = —j=. 

®. 2 v 2 

(a) Find a state-space realization of the Butterworth filter and discretize it with 
a sampling frequency 1 0 times higher than the cutoff frequency of the filter. 
Use the bilinear transformation. 


Answer: 


H(s) = 


co 


1 2 2C s 2 + 2C,co s + co 

— -s H — — s + 1 * « « 


c 0 


CO 

n 

An 2 x 10 6 


s 2 + 2000n^2s + 4tt 2 x10 6 


The controllable canonical state-space realization is given by 


*1 


0 1 


+ 

"O" 

u ,v = \ 4 k 2 x \ 0 6 0] 

X 1 

3. 


_-4tt 2 x10 6 -2000 n4l_ 

3_ 


_1_ 

7 L J 

c 

3. 


~v" 

A 


and D = 0. 

The cutoff frequency of the filter is co n = 2000 n rad/s, so we set the sampling 
frequency at O) = 20000k rad/s, so that T = 10“ 4 s. 
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f 

T ) 

-1 

( 

T ^ 

L- 

-*■ A 


1 1 + 

A 

2 

2 


2 

2 

V 

7 


V 

7 


f 

0 1 

V 

( 

0 

1 T 

I 2 -5x 10“ 5 
V 

_-4/r x 10 6 -2000 ttV2_ 

/ 

/, +5x 10“ 5 

V 

-47T 2 x10 6 

-2000^72 1 


0.8721 0.00006481 
-2559 0.2962 


' j, > 

-2 

" 0 . 00000000513 ’ 

L — -A 
2 2 

v z 7 

B = 

0.0000379 


C mn =C = [3.948 xlO 7 o] 

T f T y 1 

:= D +—C L — *-A\ B = 0.06396 

Mm 2 2 2 


(b) Plot the frequency responses of both the continuous-time and the discrete- 
time filters on the same graph up to the Nyquist frequency (half of the sampling 
frequency) in radians/second. Discuss the results and how you would imple- 
ment this filter. 


Answer: The transfer function is computed as 




bilin 


r'B; 


bilin D bilin 


0.06396 + 0. 1279z~‘ + 0.06396z~ 2 
l-1.1683z _1 + 0.424 lz' 2 


z >0.65. 



ON THE CD 


The Bode plots of H(jco) and H hUin (e j()(mUo ) up to the Nyquist frequency 
10,00071 rad/s are computed using the following MATLAB program, which is 
located in D:\Chapterl7\discretized.m on the companion CD-ROM. 


%% Exercise 17.1 discretization of Butterworth filter 
% transfer function and CT state-space model 
num=[ 1 ] ; 

den=[1/(2000*pi)~2 sqrt (2) / (2000*pi) 1]; 

[A,B,C,D]=tf2ss(num,den); 

T=[0 1; 1 0]; % permutation matrix to get same form as in Chapter 10 
A=inv (T) *A*T ; 

B=inv (T) *B ; 

C=C*T ; 
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H=ss (A, B , C, D) ; 

% bilinear transf 
T s=0 . 0001 

Ab=inv(eye(2) -0.5*Ts*A)*(eye(2)+0.5*Ts*A) ; 

Bb=Ts*inv(eye(2) -0.5*Ts*A)*inv(eye(2) -0.5*Ts*A)*B; 

Cb=C; 

Db=D+0 . 5*Ts*C*inv(eye (2) -0.5*Ts*A)*B; 

Hb=ss(Ab,Bb,Cb,Db,Ts) ; 

% Frequency response of CT Butterworth and its discretized version 
w=logspace(1 ,log10(10000*pi) ,200) ; 
w=w(1 ,1:199); 

[MAG, PHASE] = bode(H,w) ; 

[MAGbilin,PHASEbilin] = bode(Hb,w); 
figure ( 1 ) 

semilogx(w,20*log10(MAGbilin( : , : ) ) ,w,20*log10(MAG( :,:))) 
figure(2) 

semilogx(w,PHASEbilin( : , : ) , w, PHASE ( : , : ) ) 


The resulting Bode plots are shown in Figure 17. 10. 

0 

< dB > ,0 
20 
-30 
40 
-50 

-eo 

-70 

lo' 10* 10* 10* 10* 




f o (log) 


FIGURE 17.10 Bode plots of second-order Butterworth filter and 
its bilinear discretization up to the Nyquist frequency. 
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The filter can be implemented as a second-order recursive difference equation: 
y[n] =1.1 683 y[n - 1] - 0.424 1 y[n - 2] + 0.06396x[«] + 0.1 279 x[n - 1] + 0.06396x|> - 2], 

(c) Compute and plot on the same graph the first 30 points of the step response 
of the Butterworth filter and its discretized version. 

Answer: The following MATLAB script (last part of discretized.m, run after 
the script given in (b)) computes the continuous-time step response using the him 
command (which internally uses a c2d discretization) with a sampling period 10 
times shorter than T s . 

% Step responses 
figure(3) 

t = [ 0 : 0 . 00001 : .00299] ; % time vector to plot step resp of CT system 
[y,ts,x]=lsim(H,ones(1 ,300) , t) ; 
plot(ts,y) 
hold on 

[yb,tsb,xb]=lsim(Hb,ones(1 ,30) ) ; 
plot(tsb,yb, 'o' ) 
hold off 

The resulting plot is shown in Figure 17. 1 1 . 



FIGURE 17.11 Step responses of second-order Butterworth filter 
and its bilinear discretization. 
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Exercise 17.2 

Consider the causal DLTI system given by its transfer function 


H(z) = 


z 2 — z 


z 2 +0.1z-0.72 


z >0.9. 


(a) Find the controllable canonical state-space realization ( A,B,C,D ) of the 
system (draw the block diagram and give the realization.) Assess its stability 
based on the eigenvalues of A. 

Answer: The direct form realization is shown in Figure 17.12. 


H(z) = 


1 — z 1 

l + 0.1z _1 -0.72z~ 2 ’ 


z >0.9 



Controllable canonical state-space realization: 


x[n + 1] = 


0 1 
0.72 -0.1 


x\n\ + 


u[n\ 


y[«] = [0.72 -\.l]x[n]+lu[n\ 


Eigenvalues of A: 0.8,- 0.9 are inside the unit circle, and therefore the system 
is stable. 
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(b) Compute the impulse response of the system h[n\ by diagonalizing the A 
matrix. 


Answer: The impulse response of the system h[n ] is given by 
h[n] = CA n ~ x Bq[n - 1]+ D8[n] 

-yi — 1 r - 

= [" 0.72 -l.l] ° q[n-\\ + S[n\ 

L J mi j i 1 JL 

= [0.72 -l.l] 


V 

/V 


V 

n - 1 


0.7809 

-0.7433" 

0.8 

0 

"0.7809 

-0.7433" 

-l 3 

n- 1 

"o" 

0.6247 

0.6690 

0 

-0.9 

0.6247 

0.6690 

J 


l 


0.7809 

-0.7433" 

O ' 
oo 

3 

0 

"0.7809 

-0.7433" 

-A 

"o" 

0.6247 

0.6690 

0 

(-0.9)"“' 

0.6247 

0.6690 

y 

1 


= [o.72 -l.l] 

= [-0.094l(0.8)" _1 - 1.0059(-0.9)" _1 ]ry[« - 1] + S[n\. 


q[n- l] + <5[»] 

q[n-\\ + 8\n\ 


Exercises 

Exercise 17.3 

The causal continuous-time LTI system with transfer function G(s) = 0 ]. +| is 

discretized with a sampling period of T =0.01 s for simulation purposes. Use the 
c2d transformation first to get C, (/ (z), then the bilinear transformation to get 

G bl „M 


Answer: 



mm cp 


Exercise 17.4 

The causal continuous-time LTI system with transfer function G(s) = 

is discretized with a sampling period of T = 0. 1 s for simulation purposes. The 
c2d transformation will be used first, and then it will be compared to the bilinear 
transformation. 


(a) Find a continuous-time state-space realization of the system. 
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(b) Compute the discrete-time state-space system ( A c2d , B cld , C c2d , D c2d ) for 

G(s) and its associated transfer function G c2d (z), specifying its ROC. 

(c) Compute the discrete-time state-space system representing the bilinear 
transformation of G(s), (A. m , B bU . , C. f/ . , D m ) and its associated transfer 
function G mn (z\ specifying its ROC. 

( d) Use MATLAB to plot the frequency responses G(jco), G bm (e JwT ‘ ),G c2d ( e l0>T,; ) 

up to frequency ° 2 on the same graph, where (0 is the continuous-time 
frequency. Use a decibel scale for the magnitude and a log frequency scale 
for both magnitude and phase plots. Discuss any difference you observe. 


Exercise 17.5 

Consider the causal DLTI system specified by its transfer function: 

1 


H(z) = - 


2 

Z —Z 


z 2 — z + 0.5 


z > 


4 ~ 2 ' 


(a) Find the controllable canonical state-space realization ( A,B,C,D ) of the 
system. Assess its stability based on the eigenvalues of A. 

(b) Compute the zero-input response of the system y \n\ for the initial state 


m= 


by diagonalizing the A matrix. 


Answer: 



ON me CD 


Exercise 17.6 

Consider the causal DLTI system with transfer function H (z) = ; +0 ' 5 , z > 0.8. 

y v 7 z 2 -0.64 I I 

(a) Find the observable canonical state-space realization ( A,B,C,D ) of the 
system. Assess its stability based on the eigenvalues of A. 

(b) Compute the zero-input response of the system y ri [«] for the initial state 
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Exercise 17.7 

Find the controllable canonical state-space realization of the causal LTI system 
defined by the difference equation y[«]-0.4y[«-l] = 2x[«]-0.4x[«-l] and 
compute its transfer function from the state-space model, specifying its ROC. 


Answer: 



ON me CD 


Exercise 17.8 

The causal continuous-time LTI system with transfer function G(s) = is 

discretized with sampling period T =0.1 s for simulation purposes. The c2d 
transformation is used first, and then it is compared to the bilinear transformation. 

(a) Find a state-space realization of G(s) = ^ , Re{s}>-1. 

(b) Compute the discrete-time state-space system for G'(.v) using c2d and its as- 
sociated transfer function G c2d (z), specifying its ROC. 

(c) Find the bilinear transformation G bjUn (z ) of G(s), specifying its ROC. 
Compute the difference between the two frequency responses obtained 
with c2d and the bilinear transformation; that is, compute 
E(e J<0 ) := G hilm {e ’ co ) — G c2d (e ’ co ). Evaluate this difference at DC and at the 
highest discrete-time frequency. 



Appendix 

A 


Using MATLAB 


M ATLAB® is a useful and widespread software package developed by The 
MathWorks Inc. for numerical computation in engineering and science. 
MATLAB is easy to use and can be learned quickly. It comes with very 
good manuals. The purpose of this appendix is simply to provide a brief overview 
on how to use MATLAB and present some of its capabilities. 

In order to perform computations, one can use the command line, or write a 
program as a script, called an M-file, in MATLAB’s own language. This language 
is well suited to handling large vectors and matrices as single objects. Consider the 
following script: 

% Simple matrix- vector computations... 

% Define 3x3 matrix A 
A= [ 1 2 3; 4 0 -2; 12 -3] 

% Define 3x1 vector x 
x=[ -1 ; 0 ; 1 ] 

% Compute eigenvalues and eigenvectors of A 
[T,L]=eig(A) 

% L is the diagonal matrix of eigenvalues, 

T is the matrix of eigenvectors 
% Diagonalize matrix A with T 
D=inv (T) *A*T 

% Compute the product A.x 
y=A*x 

Also, mathematical functions can be used on an entire vector or matrix in one 
shot. This greatly simplifies the code. For example, the following script plots ten 
cycles of a sine wave in only three lines. 


% time vector 

t=0 : .01 : 1 ;y=sin(20*pi*t) ; 

plot(t,y) 
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The help command tells the user how to use any other command. For instance, 

» help eig 

EIG Eigenvalues and eigenvectors. 

E = EIG(X) is a vector containing the eigenvalues of a square 
matrix X. 

[ V, D] = EIG(X) produces a diagonal matrix D of eigenvalues and a 
full matrix V whose columns are the corresponding eigenvectors so 
that X*V = V*D . 

Finally, many people have developed MATLAB toolboxes over the years, 
which are collections of functions targeted at specific areas of engineering. For ex- 
ample, in this book we use commands from the Control System Toolbox, such as 
Isim to simulate the response of LTI systems. 

%simulate state-space LTI system 
SYS=ss (A, B , C , D) ; 

[YS,TS,XS] = LSIM (SYS , U , T , xO) ; 
plot (XS( : , 1 ) ,XS( : ,2) ) 



Appendix 

B 


Mathematical Notation and 
Useful Formulas 


TABLE B.l Mathematical Notation 


Notation 

Meaning 

Remark 

R 


Real numbers 


Z 


Integers 


C 


Complex numbers 


j 


J:=^l 

Imaginary number 

V 


For every, for all 


3 


There exists 


e 


Element of 


:= 


Defined as being equal to 


N\ 


N\:= 

Factorial, 0 ! = 1 

8{t), <5[w] 

CT, DT unit impulse 


u(t), u[n] 

CT, DT unit step signal 

Except for state-space 




systems for which 
u( t), u[n ] are the inputs, 
notably in Chapters 10 
and 17 

q(t), 

q[n] 

CT, DT unit step signal 

In Chapters 10, 1 1 and 17 

h(t), h[n ] 

CT, DT impulse response 


s(t), s\n\ 

CT, DT step response 


X 


(dx/dt) 


CO 

n 


Undamped natural frequency 

Second-order systems 

C 


Damping ratio 

Second-order systems 

CO 


Continuous-time frequency 

Units of rad/s 

co, Q 


Discrete-time frequency 
i‘ h eigenvalue of square 

Units of rad 


matrix A 

PU):= “ aX J A '(^) 

pu) 


Spectral radius of N X Af matrix A 

arctan 

' £ 

Four-quadrant arctan Cf.fieM 


y a ) 

are displayed with their own sign 
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TABLE B.2 Useful Formulas 


Formula 

cos(0) = ^ e ie + ~ e ~ JB = Re{e iS } 

sin(0) = — e je — — e~' e = \m{e JB } 
2 j 2 j 

e je = cos(0) + jsin(6) 


cos(0)cos(0) = ^cos(0 -(/)) + ~cos(0 + 0) 


sin(0)cos(0) = ^sin(0-0) + ^sin(0 + 0) 


sin(0)sin(0) = ^-cos(0 - 0) - ^-cos(0 + (j)) 


]>V = 


i N- 

1 -a 
1 -a 

1 


VaeC 


'Va k = , ae C, |a|<l 

k~o l — a 

z = a + j/3 = re je g C, z* = a- j/5 = re~ je 
r = |z| = yja 2 + [5 2 , 6 = Zz = arctan 
a = rcos0, (3 = rsinO 


\ a J 


Remark 


Geometric sum 


Geometric series 


Various representations of 
complex number z and its 
conjugate 
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C 


About the CD-ROM 


CD-ROM FOLDERS 


Applets: The Leamware applets 

Chapter folders: Solutions to selected problems, MATLAB scripts, and all of 
the figures from the book, organized by chapter 
Sample exams: Sample midterm and final examinations 

The companion CD-ROM to the textbook contains files for 

■ Solutions to odd-numbered problems in each chapter plus sample exams in 
PDF format 

The detailed solutions to odd-numbered problems at the end of Chapter 
kf e {1,2,. ..,17}, are given in the file D:\Chaptcr/f Chaptcntproblcms.pdf where 
D: is assumed to be the CD-ROM drive. The sample midterm tests and final 
exams are located in D:\Sample Exams\Covering Chapters 1 to 9, and D:\ 
Sample Exams\Covering Chapters 10 to 17. All of the figures from each chap- 
ter can be found as TIFF files in D:\Chaptert\Figures. 

■ Learnware applets (discrete-time convolution, Fourier series, Bode plot) 

The discrete-time convolution Java applet allows the user to enter the val- 
ues of an input signal and an impulse response and to visualize the convolution 
either as a sum of scaled and time-shifted impulse responses or as the sum of 
the values of a signal that is the product of the input signal and the time-re- 
versed and shifted impulses response. The convolution applet can be run by 
pointing a Java-enabled browser to 

D:\Applets\Convolution\SignalGraph\Convolution.html. 

The Fourier series Java applet uses an intuitive graphical user interface. 
One period of a periodic signal can be drawn using a mouse or a touchpad, and 
the applet computes the Fourier series coefficients and displays a truncated 
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sum as an approximation to the signal at hand. The convolution applet can be 
run by pointing a Java-enabled browser to 

D:\Applets\FourierSeries\FourierApplet.html. 

The Bode applet is a Windows executable (.exe) file and can be found at 
D:\Applets\BodePlot\Bode.exe. Just double-click on it and you will be able to 
build a transfer function by dragging poles and zeros onto a pole-zero plot. 
Add a value for the DC gain of the overall transfer function and you will get 
the Bode plot showing the actual frequency response of the system together 
with its broken line approximation discussed in the text. 

■ MATLAB M- files of selected examples in the text. 

These MATLAB script files, called M-files (with a .m extension) contain 
sequences of MATLAB commands that perform a desired computation for an 
example. The selected M-files are located in the Chapter^ folders. 


SYSTEM REQUIREMENTS 


Minimum: Pentium II PC running Microsoft Windows 98. Microsoft Internet 
Explorer 5 or Netscape 7 browser with Java Plug-in 1.4 ( www.sun.com ). Ac- 
robat Reader 5 (www.adobe.com). MATLAB 5.3 with Control System Tool- 
box ( www.mathworks.com ). 

Recommended: Pentium 4 PC running Microsoft Windows XP or Windows 
2000. Microsoft Internet Explorer 6 or Netscape 7 browser with Java Plug-in 
1.4 (www.sun.com). Acrobat Reader 5 ( www.adobe.com ). MATLAB 6.5 with 
Control System toolbox (www.mathworks.com). 
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■ Tables of Transforms 


TABLE D.l Fourier Transform Pairs 

Time domain x(t) 


Frequency domain X(jco) 


8(t) 


1 

u(t) 


— + nS(a>) 
jeo 

e“'u(t) 

aeC, Re{c/} < 0 

1 

jeo-a 

-e a, u{-t) 

a e C, Re{c/} > 0 

1 

jeo-a 

te a, u(t) 

a g C, Re{c/} < 0 

1 

(jeo - af 

e~ m sm(eo 0 t)u(t) 

a,co 0 el, a >0 

co 0 

(jeo + a) 2 + ml 

e~ m cos (eo 0 t)u(t) 

a,co 0 el, a >0 

jeo + a 

(jeo + a) 2 + eol 

1 


8(eo) 


co 0 g R 

S(eo-eo 0 ) 

£<5 (t-kT) 

Tel, T> 0 

fts(eo-kf) 

1 k=- oo ‘ 

jo, \t\>t 0 

f 0 el, t 0 > 0 

tn 

2f 0 sinc(— co) 
n 

eo . f eo c } sin (eo c r) 

— sine — t = — — ^ 
n \ n J nr 

co c el, co c > 0 

f 1, © < eo c 

[O, cn > eo c 


CL, G (U, 


(Fourier series) CO 0 €r M, CO 0 >0 k ._ 


^ 2nct k 8(eo-keo 0 ) 
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TABLE D.2 Properties of the Fourier Transform 


Time domain 

Frequency domain 

1 + “ 

x(t) = — f X(jco)e im dco 
2 n ^ 


+oo 

X(jco) = J x{t)e~ im dt 

ax(t ) + by(t ) 

a,b g C 

aX(jco) + bY (jco) 

x(t - 1 () ) 

f 0 g R 

e~ im °X{j(o) 

x(at) 

a g R 

rV x{A) 

d ^ 
—x(t) 
dt 


jcoX(jco) 

t 

J x(r)dT 

J x(z)dr < +« 

— X(jco) + 7tX(0)S((o) 
jco 

x(t)*y(t) 


X(jco)Y(jco) 

x{t)y(t) 


X(jCO)*Y(jCQ ) 
Z7T 

x(t) 


X*(-jco) 

x(t) g R 


1 X(;ro) 1=1 X(-jco) 1, ZX(jco) = - ZX(-jco ) 

x(t) = x(-t ) G R 


I(jffl) = IHffl)GR 

x(t) = -x(-t) G R 


X(yo) = -Z(-yffl)GyR 

i.e., purely imaginary 

+oo 

Parseval Equality: J x(Y) 

i +oo 

1 f 1 |2 

dt = — \X(jco)\ dco 
2k j 1 1 
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TABLE D.3 Properties of the Fourier Series 


Time domain 

x(t), y(t) periodic of fundamental period T 

Frequency domain 

FS FS 

x(t)<r>a k , y(t)<->b k 

x(t)= f j a k e jk( ‘ , "‘ 

k=- oo 

2 n 

ft> 0 eR,© 0 = — >° 

a k = — J x(t)e~ jka °' dt 

T T 

+oo 

x(t) = a 0 + 2^| a k | cos (k(0 Q t + Za k ) 

k=l 

x(?) G R 

a k 

x{t ) = a 0 + 

2^ [Re { } e° s ( toy ) - Im { a k } sin (toy )] 

k=\ 

x(0 s R 

a k 

ax(t) + Py(t) 

a, [5 g C 

aa k + fib k 

x(t-t 0 ) 

? 0 G R 

e- jka °‘°a k 

x(at) 

a gR, a >0 

a k 

(fund. freq. is now aco 0 ) 

x(~t) 



d 

—40 

dr 


jkco 0 a k 

t 

J x(t )dz 

/•+oo 

fl 0 = J x(T)dz = 0 

1 

a k 

jkco 0 

x(t)*h(t ) 

| \h(t)\dt<+°° 

(system must be stable) 

a k H(jkco 0 ) 

4040 


+oo 

a rrPk-m 

m=— oo 

4(0 


«*-* 

x(?) G R 


1 a k 1=1 a_ k 1 ,Zcq = 

x(0 = x(-f) G R 


e R 

x(?) = -x(-t) G R 


e 

2 +°° 

Parseval Equality: — J|x(Q|~ dt = ^ 

T T k=-^ 

1 I 2 

K| 
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TABLE D.4 Laplace Transform Pairs 


Time domain x(t) 

Laplace domain X(s) 

ROC 

i a+joo 

x(t)= f X(s)e st ds 

jin J . 

(jeC: Re{.s} = a} 
eROC 

+oo 

X(s ) = J x(t)e~ s, dt 

s g ROC 

5(0 


1 

Vs 

u(t) 


1 

s 

Re{s} > 0 

tu(t ) 


1 

s 2 

Re{s} >0 

t k u(t ) 

k = 1,2,3,... 

1 1 

~k\~7 

Re{s} > 0 

e a ‘u{t) 

ueC 

i 

s-a 

Re{s} > Re{fl} 

—e at u(—t) 

ueC 

1 

s-a 

Re{s} < Re{rv} 

e~ m sm(co 0 t)u(t ) 

a,<y 0 g R 

co 0 

(5 + a) 2 +co 2 

Re{s} > -a 

e~ m cos(co 0 Ow(0 

a,w 0 g R 

s + a 

(s + a) 2 + col 

Re{s} > -a 

s\x\(xo lt t)u(t) 

ou 0 gR 

co Q 

s 2 +<x>l 

Re{s} > 0 

cos(co 0 t)u(t ) 

Ct> 0 G R 

s 

5 +CQ 0 

Re{s} > 0 

kl<o 
jo, ? >f 0 

( 0 gR, f 0 > 0 

t n S —t n S 

e° —e 0 
s 

40 
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TABLE D.5: Properties of the Laplace Transform 


Time domain Laplace domain 

ROC 


e~ s, °X(s) 


X(s), Y(s ) 

ROC x , ROCy 

ax(t ) + by(t ) 

s C 


ROC □ ROC x n ROC Y 

0 

1 

4 

f 0 eM 

e~ s, °X(s) 

ROC x 

x(at) 

aeR 

jTxfO 

a (ay 

— ROC x 
a 

d ,, 
dt 



ROC □ ROC x 

t 

J x(r)dT 


-X(4 

s 

ROC □ ROC x n {5 : Re{s} > 0} 

e' v x(t) 

s 0 eC 

0 

1 

>< 

ROC x +Re{5 , 0 } 

40*40 


X(s)Y(s) 

ROC 3 ROC x n ROC Y 

4(0 


X*(s*) 

ROC x 

x(0 + ) 

x(0 = 0, f < 0 

x(0 + ) = limsX(0 

S— >+°o 

Initial value theorem 

lim x(0 

r-^+oo 

x(r) = 0, t < 0, 
lim x(0 < 00 

t — >+°0 

lim x(t) = lim sX(s) 

t — >+oo ,S—»0 

Final value theorem 
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TABLE D.6 Properties of the Unilateral Laplace Transform 
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TABLE D.7 Discrete-Time Fourier Transform Pairs 


Time domain x[n] 

Frequency domain X(e J0> ) 
always periodic of period 2 tc 

x[n\ = — J X(e JO, )e jmi dco 

2 n 2 K 


+oo 

X(e jm ) = X x [n]e- j(0n 

n=—o° 

8[n\ 


1 

8[n-n 0 ] 

n 0 g Z 


u[n\ 


1 +oo 

— + ^ n8(co - 2nk) 

1 — e k=-~ o 

1 


+oo 

^ 2n8{co-2nk) 

k =- oo 

u[n + n 0 ] - u\n - n 0 - 1] 

n 0 g Z, n 0 > 0 

sin co(n 0 + 1/2) 
sin(co/2) 

a"u[n ] 

a g C, a < 1 

1 

1 - 

(n + \)a n u[n ] 

a g C, a < 1 

1 

(l-A^) 2 

a"u[-n- 1] 

a g C, a > 1 

1 

r" cos (cD 0 n)u[n] 

r, co 0 g R, r > 0 

l-rcos(co 0 )e“-'® 
l-2rcos(a> 0 )<?“ 7<0 + r 2 e~ j2m 

r n sin (co 0 n)u[n] 

r, C0 0 G R, r > 0 

rsm(co 0 )e~ jco 

1 - 2r cos(© 0 )e~ Ja> + r 2 e~ j2<0 

cos (co 0 n) 

a> 0 g R 

+oo 

n ^ 8(co -co 0 - Ink) + 8(co + co 0 - Ink) 

k=—°° 

sin(m 0 n) 

co 0 G R 

+oo 

jn - 8 {co — (o 0 — 2 nk) + 8(co + co 0 - 2 nk) 

sin con (O r . . ( (On \ 

— = — sine — 1 — 

nn n \ n J 

co c gR, 

0 < (0 C < K 

fl, \(o-k2n\<co c ,keZ 
[0, otherwise 
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.,2k 
jk — n 

x[n\ = 2j a k e N 

k=(N) (DTFS) 

eC 

X 2 7Ta k S(co-k^-) 

^ S[n-kN\ 

k=-o° 

N eZ, N >0 

— X s(co- k —) 
N£L N 
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TABLE D.8: Properties of the Discrete-Time Fourier Transform 


Time domain 

Frequency domain 

x[n\ = — J X{e ia )e Jcon d(D 

2n 2n 


= £ x[n]e - ^" 

n=—°o 

ax[n] + by[n\ 

a,b e C 

aX{e j(0 ) + bY{e jC0 ) 

x[n - n 0 ] 

n 0 e Z 

e- jmn °X(e j(0 ) 

x\-n\ 


X(e jm ) 

e jo>0 "x[n\ 

(S 0 eR 

X{e K(0 ~ a ° a) ) 

nx[n\ 


.dX(e ja> ) 
J do) 

n 
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X*(e- jm ) 
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TABLE D.9: Properties of the Discrete-Time Fourier Series 


Time domain 

x[tt], y[n] periodic, fund. 


period N, fund. freq. ft) 0 = — 








Frequency domain 
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aa k +pb k 

x[n - n 0 ] 
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TABLE D.10 z-Transform Pairs 


Time domain x[n\ 

z domain X(z ) 

ROC 

x[n\ = <kx(z)z n x dz 

J' 2n C 

C := (z e ROC : 
z = /•} 

+oo 

X(z) = £ x[«]z“" 

n=—oo 

z g ROC 

8[n ] 


1 

Vz 

8[n-n 0 ] 

n 0 g Z 

z~ n ° 

Vz/ {0}, n 0 > 0 
Vz/ {oo}, n Q < 0 
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1 

l-z“ J 

| z > 1 

u[n + « 0 ] — u\n — n 0 — 1] 

n 0 g Z 

z"° — z _w ° -1 
1-z -1 

Vz / {0,°°} 


fl G C, fl < 1 

1 

1- az~ l 

H > H 

— a"w[— n — 1] 

a g C, a > 1 

1 

1 - az~ l 

|z| < \a\ 

(h + \)a n u[n ] 

fl G C, fl < 1 

1 

(1-az -1 ) 2 

|z| > |fl| 

r” cos(co 0 «)w[ra] 

r,(O 0 gM, r > 0 

1 - rcos(ft> 0 )z _1 
1 - 27'cos(ft> 0 )z _1 + r 2 z~ 2 

z > r 

r" sin(w 0 «)«| //] 

r,(O 0 g 1, r > 0 

rsin(ft) 0 )z _1 

1- 2rcos(© 0 )z~ 1 + r 2 z 2 

z > ?• 





Fundamentals of Signals and Systems 


TABLE D.l 1 : Properties of the z-Transform Pairs 


Time domain 

z domain 

ROC 

x[n], y[n ] 


*(z), 7(z) 

ROC x , ROCy 

+ by[n\ 

a,b e C 

aX(z) + Z77(z) 

ROC □ ROC x n ROC y 

x[n - n 0 ] 

n 0 g Z 

z""°I(z) 

ROC x , except possible 
addition/removal of 0 or °° 

x[-n\ 


X(z-‘) 

{z 1 : z g ROC x } 

z 0 "x[n] 

z 0 gC 

/ A 

X ± 

l z <J 

z 0 ROC x 
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dX(z) 

—z 

dz 

ROC x 

n 

X 4m] 
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— *(z) 

(1-z ) 
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x\n ] - x[n - 1] 


(l-z-')X(z) 
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x lJ«] 
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777 > 0 
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{z' lm : z e ROC x } 

x[ri\ * y[n\ 


X(z)Y(z) 
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TABLE D.12: Properties of the Unilateral z-Transform 


Time domain 

z domain 

ROC 

x[n\, y[n\ 


%(z), %(z) 

ROC X , ROCy 

ax[n\ + by[n\ 

a,b g C 

a%(z) + b'lf(z) 

ROC □ ROC x n ROC y 

x[n - 1] 


z~ 1 ^(z) + x[- 1] 

ROC x , except possible 
removal of 0 

x\n + 1] 


z'X(z)- zx[0] 

ROC x , except possible 
addition of 0 

x\ n — n 0 ] 

n 0 g Z 
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+ x[-n Q ] 
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V Z 0 y 
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nx[n] 
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z 

dz 
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active filters and operational amplifier 
circuits, 340-343 

actuators in feedback control systems, 383 
algebra, transfer function, 477 
aliasing 

and continuous-time signal sampling, 
549-552 

and discrete-time signal sampling, 560 
all-pass systems, 3 1 6-3 1 9 
amplitude modulation (AM) 

with complex exponential, sinusoidal 
carriers, 578-581 

single-sideband (SSB-AM), 587-590 
analog filter control and Fourier series 
representation, 132 
analog-to-digital (A/D) converter, 555 
analysis 

closed-loop stability, of LTI feedback 
control systems, 394-400 
of DLTI systems using z-transform, 
474^78 

of linear time-invariant LTI electrical 
circuits, 329 

of LTI systems using Laplace trans- 
form, 241-243, 272-273 
of LTI systems with block diagrams, 
264-271 

stability, using root locus, 400^104 
angle modulation, 599-604 
antialiasing filters, 551-552, 614-615 
aperiodic signals 

energy-density spectrum of, 1 83 
Fourier transform of sawtooth, 

187-188 

applets, Java Convolution, 59 
arrays, Routh, 399-400 
associative property 

convolution operation, 69 
of LTI systems, 76-77 
asynchronous demodulation, 583-586 

B 

bandpass filters 

and associative property of LTI 
systems, 76-77 
ideal, 517-519 
beating phenomenon, 583 
bel unit described, 290 
Bell, Alexander Graham, 290 
BIBO stability 
See also stability 
of differential and difference LTI 
systems, 112-116 
of LTI systems, 78-79 
and LTI systems using Laplace 
transform, 241-243 
system property, 41-42 
and transfer function of LTI system, 
262-263 

bilateral z-transform, 484-485 
bilinear transformation, using for dis- 
cretization, 631-635 


block diagrams 

analysis of LTI differential systems, 
264-271 

car cruise control system, 265-266 
electromechanical feedback control 
system (fig.), 385 

LTI feedback control system (fig.), 383 
realization of rational transfer function, 
480^183 

representation of DLTI systems, 477 
representation of continuous-time 
state-space systems, 372-373 
system, 35-38 
Bode, Hendrik, 3 1 6 
Bode plots 

and frequency response plots, 219 
of third-order loop gain (fig.), 412 
time and frequency analysis of continu- 
ous time TLI systems, 290-296 
bounded-input bounded-output. See BIBO 
Butterworth filters, 205-207, 306, 

637-640 


C 

c2d operator, 628-63 1 
calculating 

convolution integral, 69-74 
impulse response of differential, 
difference LTI systems, 101-109 
capacitors, instantaneous discharge of, 
30-32 

car cruise control system, 265-267 
carriers, Fourier transform of, 182 
cars 

cruise control system, 265-267 
forces acting on, and differential 
equations, 93 

cascade interconnection, 36, 42 
cascade realization, obtaining of transfer 
function, 270 

cascades of LTI systems, 76 
causal LTI systems 

described by difference equations, 
96-101 

described by differential equations, 
92-96 
causality 

of LTI systems, 78, 241 
system property, 40—4 1 
of transfer function of LTI system, 
261-262 

and z-transform, 475 
CD-ROM, accompanying this book 
folders, system requirements, 649-650 
interactive Bode applet, 293, 650 
Java Convolution applet, 59 
chain rule of impulse, 106 
characteristic polynomials 

and differential and difference LTI 
system stability, 112-116 
impulse response of differential LTI 
systems, 104 
characterization 


of DLTI systems using z-transform, 
474^78 

of LTI systems using Laplace trans- 
form, 241-243 
circuit analysis 

and differential and difference LTI 
systems, 9 1 

mesh analysis review, 332-334 
nodal analysis review, 330-332 
circuits 

electrical. See electrical circuits 
filter, and LTI controllers, 53 
operational amplifier (op-amp), 
340-343 

transform circuit diagrams, 334-340 
closed-loop stability analysis, 394-400 
co-domains of continuous-time function, 3 
coefficients, Fourier series, 135, 137-139, 
142 

communicative property 

convolution operation, 69, 7 1 
of LTI systems, 74-75, 120 
communication systems 

angle modulation, 599-604 
frequency-division multiplexing, 
597-599 

introduction to, 577 
modulation of a pulse-train carrier, 
591-592 

pulse-amplitude modulation, 592-595 
single-sideband amplitude modulation, 
586-590 

sinusoidal AM, and complex exponen- 
tials, 578-581 

sinusoidal AM, demodulation of, 
581-586 

time-division multiplexing, 595-597 
complex exponential signals 

amplitude modulation with, 578-579 
DTFT of, 445-446 
Fourier transform of, 184-187 
harmonically related, 17-18 
complex harmonics, 1 8 
compression of signals, 5 
computations of convolution, 59-66 
conjugate symmetry 
and DTFS, 434^135 
and DTFT, 444 
of Fourier transform, 1 80-1 8 1 
conjugation 

and DTFS, 434^135 
and DTFT, 444 
of Fourier transform, 180 
of periodic signals, and conjugate 
symmetry, 141 

of two-sided Laplace transform, 238 
and unilateral Laplace transform, 245 
and z-transform, 467 
continuous-time Fourier transform, 
175-184 

continuous-time LTI systems 
convolution integral, 67-74 
discretization of, 617-622 
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relation of transfer function poles and 
zeros to frequency response, 286-290 
state models of, 351-360 
continuous-time signals 

complex exponential signals, 12-17 
described, 2-3 

discrete-time processing of, 552-557 
even signals, 23 

Fourier series representation pf periodic, 
134-137 

periodic complex exponentials, 17-19 
properties of Fourier series, 139-141 
real exponential signals, 9-12 
sinusoidal signals, 19 
unit step signal (fig.), 27 
continuous-time state-space systems 
block diagram representation of, 

372-373 

Laplace transform solution for, 367-370 
zero-state, zero-input response of, 
361-366 

continuous-time systems, discretization of, 
628-636 

continuous-time to discrete-time operator 
(CT/DT), 553 

contour integration in the z-plane, 468 
contour, Nyquist, 405 
control systems, introduction to LTI 
feedback, 381-394 
controllable canonical form 

deriving state-space model from, 
352-355,618-621 
described, 27 1 , 269 
transfer function, 482 
controllers 

in feedback control systems, 382-383 
naive approach to design, 393-394 
convergence 

of discrete-time Fourier transform, 439 
of Fourier series, 141-148 
of Fourier transform, 192 
pointwise, 147 

region of convergence (ROC), Laplace 
transform, 225 

of two-sided Laplace transform, 

234-235 

and z-transform, 464 
convolution 

and Fourier transform, 181-182 
graphical computation of, 59-62 
integral, 69-74 

integral, continuous-time LTI systems, 
54-66 

and LTI system properties, 74-80 
numerical computation of, 62-66 
periodic, of two signals, 433-434 
property in LTI system analysis, 

192-199 

property of two-sided Laplace trans- 
form, 238-239 

property of unilateral Laplace transform, 
245 

sum, convolution integral, 62-69 
sum, discrete-time LTI systems, 54-66 
of two signals, DTFT, 442^143 
of two signals, z-domain, 466 
critically damped systems, 302 
CT/DT (continuous-time to discrete-time) 
operator, 553 
cycles, duty, 143-144 


damped 

natural frequency, 312 

and overdamped systems, 302-305 

sinusoidal signals, 13-15, 187 


dampening ratio vs. percentage overshoot 
(table), 313 

DC motors and LTI controllers, 53 
decibels 

described, 290 

gain values expressed in (table), 29 1 
decimation of signals 
See also downsampling 
described, 5 

and impulse train sampling, 559 
delay, group, 316 
delay systems, ideal, 315 
demodulation 

of FM signals, 601-604 
of sinusoidal AM, 581-586 
synchronous, 590 

for time-division multiplexing, 595-597 
demultiplexing, 598 
design 

of controllers, 393-394 
FIR filters by windowing, 527-53 1 
use of differential and difference LTI 
systems in, 91 
diagonalizing matrixes, 361 
diagrams 

Bode plots, 290-296 
system block, 35-38 
transform circuit, 334-340 
difference LTI systems 

See also LTI difference systems 
definition of, 96-101 
impulse response of, 109-1 12 
differential equations describing casual LTI 
systems, 91-101 
differential LTI systems 

See also LTI differential systems 
definition of, 92-96 
impulse response of, 101-109 
differentiation 

signals, and Fourier transform, 181 
and two-sided Laplace transform, 239 
and unilateral Laplace transform, 247 
in z-domain, 466 

digital filter control and Fourier series 
representation, 132 

digital-to-analog (D/A) converter, 556 
direct form transfer function, 269, 271 
Dirichlet conditions and Fourier series 
representation, 146 
discrete-time 

filters, ideal, 510-519 
processing of continuous-time signals, 
552-557 

discrete-time Fourier series (DTFS) 
described, 425^130 
properties of, 430-435 
duality between analysis and synthetic 
equations of, 449^150 
discrete-time Fourier transform (DTFT) 
described, 435^439 
geometric evaluation from pole-zero 
plot, 498-504 

of periodic, and step signals, 445^149 
properties of, 439-444 
and z-transform, 460, 497-504 
discrete-time impulse and step signals, 
25-26 

discrete-time linear time-invariant systems. 

See DLTI systems 
discrete-time signals 
described, 2-3 

complex exponential, sinusoidal signals, 
20-21 

convolution between, 66 
Fourier transforms of aperiodic, 
435-439 


odd signals, 23 

real, complex exponential, 9-17 
representing in terms of impulses, 54-57 
sampling, 542-546 
sampling of, 557-563 
discrete-time state-space systems 
z-transform solution of, 625-627 
zero-state, zero-input responses of, 
622-625 

discretization. See system discretization 
discriminators, 601 
distributive property 

convolution operation, 69 
of LTI systems, 75-76 
DLTI (discrete-time linear time-invariant) 
systems analysis and characterization 
using z-transform, 474^178 
convolution sum, 54-66 
described, 426 
domains 

mapped by time functions, 3 
time. See time domain 
downsampling 
described, 5 
and DTFT, 441 

DTFS. See discrete-time Fourier series 

DTFT. See discrete-time Fourier transform 
duality 

in discrete-time Fourier series, 449-450 
and F ourier transform, 191-192 
duty cycle described, 143 


eigenfunctions, eigenvalues of LTI systems, 
117-118 

electrical circuits 
See also circuits 

Laplace transform technique application 
to, 329-343 

electrical engineering, Parseval theorem 
applicability, 151 
energy-density spectrum 
of aperiodic signal, 1 83 
and DTFT, 444 

engineering systems described, 2 
envelope detectors, 584, 586, 598, 607 
equality, Parseval, 150-151 
equations 

See also specific equations 
difference. See difference equations 
differential. See differential equations 
state, of systems, 351-352 
synthesis, 135 

error signals in feedback control systems, 
382-383 

Euler’s relation, 13, 15 
even and odd signals, 23-25 
expanded signals, 5 

expanding periodic discrete-time signals, 
425 

exponential signals 

linear combinations of harmonically 
related complex, 132-134 
real and complex, 9-17 
truncated (fig.), 27 


feedback control 

car cruise control system, 265-266 
and Fourier series representation, 132 
history of, 381 
and rise time, 3 1 1 
systems described, 382-383 
feedback interconnection 
described, 37-38 

between two LTI systems (fig.), 217 
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filter circuits and LTI controllers, 53 
filter design and differential and difference 
LTI systems, 91 
filtering 

the Fourier transform and, 202-210 
periodic signals with LTI system, 156 
filters 

active, and operational amplifier cir- 
cuits, 340-343 
antialiasing, 551-552 
Butterworth, 205-207, 306 
finite-impulse response (FIR), 521-531 
and Fourier series representation, 132 
ideal discrete-time, 5 1 0-5 1 9 
infinite impulse response (IIR), 519-521 
quality Q of, 305 
final-value theorem, 240, 247 
finite-energy signals and finite-power 
signals, 21-23 

finite-impulse response (FIR) filters, 
521-531 

finite-power and finite-energy signals, 
21-23 

finite support, signal characteristic, 4 

FIR filters, 521-531 

first-order 

lag, transfer function of, 296-298 
lead, transfer function of, 298-300 
systems, frequency analysis of, 504-506 
first-order hold (FOH) and signal recon- 
struction, 548-549 
flatness of filters, maximum, 306 
folders, CD-ROM, 649-650 
forced response, 94, 98 
formulas, mathematical (table), 647-648 
Fourier series 

coefficients, graph of, 137-139 
convergence of, 141-148 
definition and properties of, 131-141 
discrete-time. See discrete-time Fourier 
series 

Fourier transform. See Fourier transform 
optimality and convergence of, 144-146 
of periodic rectangular wave, 141-144 
of periodic train of impulses, 148-150 
properties of continuous-time, 139-141 
representation of, 131-137, 146-148 
Fourier transform 

of aperiodic discrete-time signals, 
435^139 

continuous-time, definition and proper- 
ties, 175-184 
convergence of, 192 
discrete-time. See discrete-time Fourier 
transform 
duality, 191-192 
examples of, 184-188 
filtering and, 202-2 1 0 
inverse, 188-191 
and Laplace transform, 223 
as limit of Fourier series, 176-179 
and LTI differential systems, 194-199 
of periodic signals, 197-202 
properties of, 180-184 
frequency 

modulation (FM) and demodulation of 
signals, 601-604 

natural, of first-order LTI differential 
system, and time constant, 116-118 
and period in sinusoidal signals, 19 
scaling of Fourier transform, 1 80 
shifting and DTFT, 440 
of signals, and Fourier representation, 
132 

frequency analysis 

of first-order systems, 504-506 


of second-order systems, 506-509 
frequency-division multiplexing (FDM), 
597-599 

frequency domain 

differentiation in two-sided Laplace 
transform, 239 
filtering effect in (fig.), 203 
frequency response 

and Bode plots, 290-296 
determining with pole-zero plot, 498 
of first-order lag, lead, and second-order 
lead-lag systems, 296-300 
relation of transfer function poles and 
zeros to, 286-290 
of second-order systems, 300-307 
frequency-selective filters, 202-203 
functions 

domains, co-domains, ranges, 3 
generalized, and input-output system 
models, 26-32 

sine, Fourier series representation (fig.), 
142 

transfer, 118 


G 

gain 

loop, 386 
matrix gains, 372 

and phase margins, stability robustness, 
409-413 

of system, and frequency, 299 
of system, measuring, 290 
values expressed in decibels (table), 291 
generalized functions and input-output 
system models, 26-32 
generating periodic signals, 149 
geometric evaluation of DTFT from pole- 
zero plot, 498-504 

Gibbs phenomenon and Fourier series 
representation, 147-148, 157 
governor, Watt, 381-382 
graphical computation of convolution, 
59-62 

group delay, definition of, 316 
growing sinusoidal signals, 13-15 

H 

Hamming window, 529 
harmonic distortion, total (THD), 153-155 
harmonically related complex exponential 
signals, 17-18, 132-134 
harmonics, complex, 1 8 
help, MATLAB, 646 
highpass filters 

and Fourier transform, 207- 210 
ideal, 514-517 
Hilbert transformers, 589 
homogeneity, system property, 38-39 

I 

ideal delay systems, 3 1 5 
ideal discrete-time filters, 510-519 
ideal highpass filters, 207-210 
ideal lowpass filters, 191, 203-207 
IIR filters, 519-521 
impulse response 
described, 30 

of difference LTI systems, 109- 112 
of differential LTI system, 101-109 
of ideal lowpass filter (fig.), 204 
and input signal for numerical computa- 
tion of convolution (fig.), 59 
z-transform of, 460 
impulse signal properties, 32-33 
impulse train 

described (fig.), 148 


and its Fourier transform (fig.), 449 
sampling, 557-558 
signals, Fourier transform of periodic, 
200-202 
impulses 

Fourier series of periodic train of, 
148-150 

representation of continuous-time 
signals, 67-68 

representation of discrete-time signals, 
54-55 

infinite impulse response (IIR) filters, 
519-521 

initial rest condition 

of LTI casual system, 97 
of systems, 95 

initial-value theorem, 240, 247 
input-output, system models, 26-38 
input signal, notation in state-space sys- 
tems, 352 

integral, convolution, 54-66, 69-74 
integration of signals, and Fourier trans- 
form, 181 
interconnection 

cascade, parallel, feedback, 36-38 
system, using transfer functions, 265 
interest, calculating with differential 
equation, 128 

intersymbol interference in PAM systems, 
594-595 

inverse F ourier transform, 188-191 
inverse Laplace transform, 226-234, 331 
inverse systems, 42 
inverse unilateral z-transform, 484 
inverse z-transform, 468-474 
invertibility 

of LTI systems, 77-78 
system property, 42 

K 

Kirchhoff s Current Law (KCL), 330 
Kirchhoff s Voltage Law (KVL), 332 

L 

lag systems, frequency responses of, 
296-300 

Laplace function of system’s impulse 
response, 118 
Laplace transform 

application to LTI differential systems, 
259-271 

convergence of two-sided, 234-235 
definition of two-sided, 224-226 
inverse, 226-234 

poles and zeros of rational, 235-236 
state-space systems solutions, 367-373 
two-sided. See two-sided Laplace 
transform 

unilateral. See unilateral Laplace 
transform 

Laurent series and z-transform, 459 
lead, lead-last systems, frequency responses 
of, 296-300 
Leamware applets, 649 
l’Hopital’s rule, 215, 251 
line spectrum of signals, 137-139 
linear constant-coefficient difference 
equation, 96 

linear time-invariant. See LTI 
linearity 

continuous-time Fourier series, 139 

and DTFS, 431 

and DTFT, 440 

of Fourier transform, 180 

system property, 38-39 

of two-sided Laplace transform, 236 
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of unilateral Laplace transform, 244 
and z-transform, 465 
logarithmic scale and Bode plots, 290 
loop gain described, 386 
lowpass filters, 1 69- 1 7 1 

and Fourier transform, 203-207 
ideal, 191,510-514 
second-order RLC, 301 
LTI (linear time-invariant) systems 
analysis and characterization using 
Laplace transform, 241-243 
continuous-time. See continuous-time 
LTI systems 

convolution property in, 192-199 
convolution sum, 53-62 
described, 1, 91-96 
difference. See difference LTI systems 
differential. See differential LTI systems 
discrete-time, convolution sum, 54—66 
eigenfunctions, eigenvalues, 117-118 
exponential signals, 9-17 
frequency response of, 132 
invertibility of, 77-78 
modeling physical processes with, 53 
multivariable, 373 
properties of, 74-80 
response to periodic input, 155-157 
Routh’s stability criterion, 398-400 
steady-state response to periodic signals, 
155-157 

transfer function of, 260-264 
without memory, 77 
LTI difference systems 

See also difference LTI systems 
state models of, 6 1 7-622 
transfer function characterization of, 
478^180 

LTI differential systems 

See also differential LTI systems 
analysis with initial conditions using 
unilateral Laplace transform, 

272-273 

application of Laplace transform to, 
259-271 

BIBO stability of, 113-114 
Fourier transform and, 194-199 
time constant and natural frequency of 
first-order, 116-118 
transient and steady-state responses of, 
274-276 

LTI feedback control systems 

closed-loop stability analysis, 394-400 
introduction to, 381-394 
stability analysis using root locus, 
400^104 

M 

M-files, 645 

mass-spring-damper system, 301, 322-325 
mathematical notation, formulas (table), 
647-648 

Math Works Inc., 645 
MATLAB software package, using, 
645-646 

maximum flatness of filters, 306 
mechanical mass-spring-damper system, 
301 

memory 

LTI systems without, 77 
and memoryless systems, 40 
mesh analysis 

of circuits, 332-334 
transform circuit for, 338-340 
minimal state-space realizations, 369 
models 


input-output system, 26-38 
signal, 1-1 1 
state. See state models 
system. See system models 
modulation 

angle, 599-604 

pulse-amplitude (PAM), 592-595 
of pulse-train carrier, 591-592 
motors, DC, and LTI controllers, 53 
moving-average filters, 522-524 
multiplexing 

frequency-division (FDM), 597-599 
time-division, 595-597 
multiplication 

and convolution property, 1 82 
of two signals, 140-141 
of two signals, DTFS, 434 
of two signals, DTFT, 443 

N 

nodal analysis 

of electrical circuits, 330-332 
transform circuit for, 334-338 
noise and ideal discrete-time filters, 5 1 0 
non-minimum phase systems, 316-319 
noncausal systems, 4 1 
notation, mathematical (table), 647-648 
Nth harmonic components of signals, 1 33 
numerical computation of convolution, 
62-66 

Nyquist criterion for stability analysis, 
404^109 

O 

observable canonical form 

deriving state-space model from, 
621-622 

deriving state-space system model from, 
355-357 

odd and even signals, 23-25 
op-amp circuits, 340-343 
operational amplifier circuits, 340-343 
operators 

c2d, 628-631 

CT/DT (continuous-time to discrete- 
time), 553 

DT/CT (discrete-time to continuous- 
time), 555-556 

optimality of Fourier series, 144-146 
orthogonal sets of signals, 1 8 
output disturbance, 383 
overdamped systems, 302 
overshoot of step response, 311-313 

P 

PAM (pulse-amplitude modulation) 
systems, 594-595 
parallel interconnection, 36-37 
Parseval equality 
and DTFT, 444 
for Fourier transforms, 184 
Parseval theorem and signal power, 
150-151, 162 

partial fraction expansion, 228 
passband described, 202, 510 
period and frequency in sinusoidal signals, 
19 

periodic 

complex exponential and sinusoidal 
signals, 17-21 

input, LTI systems’ response to, 
155-157 

rectangular waves, Fourier series of, 
141-144 
periodic signals 


classes with Fourier series representa- 
tion, 146 

continuous-time, Fourier series repre- 
sentation of, 134-137 
described, 8-9 
discrete-time (fig.), 435 
DTFT of, 445^149 
Fourier transform of, 197-202 
fundamental frequency of, 1 32 
power spectrum of, 151-152 
setup for generating (fig.), 149 
steady-state response of LTI system to, 
155-157 

phase-lock loop (PLL), 601, 603 
phase 

margins in stability analysis, 409-413 
plane, state trajectories and, 370-372 
systems, non-minimum, 316-319 
PLL (phase-lock loop), 601, 603 
pointwise convergence, 147 
pole-zero plot 

determining system’s frequency re- 
sponse with, 498 

geometric evaluation of DTFT from, 
498-504 

qualitative evaluation of frequency 
response from, 285-290 
of transfer function (fig.), 321 
of z-transform (fig.), 463, 468 
poles 

and zeros of rational Laplace transforms, 

235- 236 

and zeros of transfer function, 260-261 
polynomials 

characteristic, of LTI difference system, 
114-116 

characteristic, of LTI differential 
system, 1 12 

power engineering and Fourier series 
representation, 132 
power series of z-transform, 473-474 
power spectrum of signals, 151-152 
Principle of Argument, 404^405 
Principle of Superposition 

and linear discrete-time systems, 55 
and linear property of LTI systems, 68 
process models and differential and differ- 
ence LTI systems, 91 
properties 

basic system, 38^12 
of continuous-time Fourier series, 
139-141 

convolution, in LTI system analysis, 
192-199 

of discrete-time Fourier series, 430^135 
of discrete-time Fourier transform, 
439^144 

of Fourier series, 131-141 
of Fourier transform, 1 80-1 84 
of impulse signal, 32-33 
LTI systems, 74-80 
of two-sided Laplace transform, 

236- 240 

two-sided z-transform, 465^168 
of unilateral Laplace transform, 

244-247 

unilateral z-transform, 484-485 
of z-transform, 465^168 
pulse-amplitude modulation (PAM), 
592-595 
pulse signals 

continuous-time rectangular (fig.), 28 
integration of rectangular, and step unit 
(fig-), 29 

pulse-train carrier, modulation of, 591-592 
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Q 

qualitative evaluation of fre-quency 
response from pole-zero plot, 

285-290 

quality Q of filters, 305-306 

R 

range of continuous-time function, 3 
rational transfer functions 

block diagram realization of, 480-483 
LTI differential systems and, 259-264 
RC circuits 

filtering periodic signal with, 156 
impulse response, step response (figs.), 
80 

real discrete-time exponential signals, 10 
real exponential signals, 9-12 
realizations 

of first-order lag (fig.), 298 
of LTI differential systems, 264 
obtaining of transfer function, 268-272 
reconstructing signals, 546-549, 560-563 
rectangular waves 

input to LTI system (fig.), 164 
periodic, Fourier series of, 141-144 
reference signals in feedback control 
systems, 382-383 
region of convergence (ROC) 

of inverse Laplace transform, 226-234 
of Laplace transform, 225 
of z-transform, 464-465, 474^176 
regulators in feedback control systems, 
386-387 

repeating signals. See periodic signals 
representing 

continuous-time signals in terms of 
impulses, 67-68 

discrete-time periodic signals with 
Fourier series, 426-430 
discrete-time signals in terms of im- 
pulses, 54-57 
Fourier series, 131-132 
periodic signals using Fourier transform, 
197-202 

resistance, finite-energy and finite-power 
signals, 21-23 

resistances and impedances in Laplace 
domain, 336 

resistor-inductor-capacitor. See RLC 
circuits 
responses 

forced, zero-state, 94 
frequency. See frequency response 
impulse. See impulse response 
steady-state, of LTI system to period 
signal, 155-157 
step. See step response 
zero-state, zero-input, 360-366 
reversal, time, 6 

rise time of step response, 307-311 
RLC (resistor-inductor-capacitor) circuits, 
deriving state-space representations 
from, 357-360 

robustness, stability, 409^113 

ROC. See region of convergence 

root locus and stability analysis, 400^104 

Routh, E.J., 398 

running sum of signals, 434 

S 

sampled-data systems, 552, 556 
sampling 

aliasing and, 549-552 
described, 541 


of discrete-time signals, 542-546, 
557-563 

property, impulse signal, 32-33, 106 
sawtooth signals 

in Fourier series representation, 136 
Fourier transform of aperiodic, 187-188 
line spectrum of (fig.), 138 
scaling 

time. See time scaling 
in z-domain, 465 
second-order systems 

frequency analysis of, 506-509 
frequency response of, 300-307 
sensitivity function and feedback control 
systems, 387-390 

settling time of step response, 313-315 
shift, time, 7 
sidebands, AM, 587-590 
signal interpolation using perfect sine 
function, 547 
signal models, 1-1 1 
signal reconstruction, 546-549 
signals 

See also specific signal type 
continuous-time, discrete-time, 2-3 
described, 1 

discrete-time impulse and step, 25-26 
even and odd, 23-25 
exponential, described, 9-17 
finite-energy, and finite-power, 21-23 
frequency spectrum of, 1 32 
function of time as, 2-4 
fundamental components of, 133 
impulse, 32-33 

and Laplace transform. See Laplace 
transform 

low-distortion transmission over com- 
munication channel, 77 
orthogonal sets, 1 8 
periodic complex exponential and 
sinusoidal, 17-21 
periodic, described, 8-9 
power spectrum of, 151-152 
satisfying Dirichlet conditions, 146 
sawtooth. See sawtooth signals 
some useful, 12-26 
sine function 

Fourier series representation, 142 
perfect signal interpolation using, 547 
single-sideband amplitude modulation 
(SSB-AM), 587-590 
sinusoidal AM 

and AM radio, 586 
demodulation of, 581-586 
sinusoidal signals 

aliasing of (fig.), 550 
amplitude modulation with, 579-581 
complex exponentials, 20-2 1 
continuous-time, 19 
dampened, growing, 13-15 
and periodic complex exponential 
signals, 17-21 
slowed down signals, 5 
spectral coefficients 

and Fourier series representation, 135 
of impulse train (fig.), 149 
spectrum 

energy-density, of aperiodic signal, 1 83 
line, of signals, 137-139 
of signal and carrier (fig.), 1 82 
signal frequency, 1 32 
sped up signals, 5 

square wave signal, continuous-time 
periodic (fig.), 8 


stability 

See also BIBO stability 
closed-loop analysis, 394-400 
for DLTI systems, 415-416 
Nyquist criterion, plot, 404- 409 
robustness, 409-413 
Routh’s criterion for, 398^100 
theorem, 369, 626 

using Fourier transform on LTI differen- 
tial systems, 194 

stability analysis using root locus, 400-404 
stable LTI systems 

step response of, 307-315 
time and frequency analysis of continu- 
ous time, 285-290 
state models of continuous-time LTI 
systems, 351-360 
state-space models 

deriving with controllable canonical 
form, 618-621 

deriving with observable canonical 
form, 621-622 

state-space systems, Laplace transform 
solution for continuous-time, 367-373 
state trajectories and the phase plane, 370-372 
states in systems described, 351-352 
steady-state and transient response of LTI 
differential systems, 274-276 
step-invariant transformation, using for 
discretization, 628-636 
step response 

impulse response obtained by differenti- 
ation of, 106-109 
of stable LTI systems, 307-315 
of systems, 27 
unit, of LTI system, 79-80 
step signals 

and discrete-time impulse signals, 25-26 
DTFT of, 445^149 
stopband described, 202, 510 
sum, convolution, 54-66 
superheterodyne receivers, 598-599, 
612-613 

supemodes, 331, 337, 341 
superposition principle, 55 
suspension systems, 322, 323 
synchronous demodulation, 581-583, 590 
synthesis equation, 135 
system 

step response of, 27 
term’s use in engineering, 2 
system discretization 

of continuous-time systems, 628-636 
described, 617-618 
using bilinear transformation, 631-635 
using step-invariant transformation, 
628-631 
system models 

basic system properties, 38^42 
input-output, 26-38, 35 
system block diagrams, 35-38 
system requirements, CD-ROM, 650 
systems 

See also specific system 

basic properties, 38-42 

feedback control, described, 382-383 

first-order. See first-order systems 

ideal delay, 3 1 5 

initial rest state, 95 

linear time-invariant. See LTI 

PAM, 594-595 

sampled-data, 552, 556 

second-order. See second-order systems 

states in, 351-352 
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THD (total harmonic distortion), 153-155 
time 

constant of first-order LTI differential 
system, and natural frequency, 
116-118 

delay and unilateral Laplace transform, 
244-245 

functions of, as signals, 2^1 
settling, vs. percentage overshoot 
(table), 313 

time-division multiplexing, 595-597 
time domain 

differentiation in two-sided Laplace 
transform, 239 

differentiation of unilateral Laplace 
transform, 246 

time expansion. See upsampling 
time invariance, system property, 39-40 
time reversal 

in continuous-time Fourier series, 140 
and DTFS, 431 
and DTFT, 440 
functions for, 6 
and z-transform, 466 
time scaling 

in continuous-time Fourier series, 140 
described, 4-6 
and DTFS, 431^433 
and DTFT, 441 
of Fourier transform, 180 
of impulse signal, 32-33 
of two-sided Laplace transform, 237 
and unilateral Laplace transform, 245 
time-shifted impulses 

in continuous-time Fourier series, 
139-140 

in discrete-time signals, 54-77 
time shifting 
described, 7 
and DTFS, 431 
and DTFT, 440 
of Fourier transform, 180 
of two-sided Laplace transform, 
236-237 

and z-transform, 465 
time variable, transformation of, 4-7 
total harmonic distortion (THD), 153-155 
tracking with unity feedback system, 385 
train, impulse (fig.), 148 
transfer function 

algebra, and z-domain, 477 
Bode magnitude plots (fig.), 292, 295 


Bode phase plots (fig.), 293, 295 
characterization of LTI difference 
systems, 478-480 

of differential LTI system, 260-264 
of DLTI systems, 474 
first-order lag, 296-298 
ideal delay systems, 3 1 5 
of LTI systems, 1 18, 241 
Nyquist plot of, 406^109 
obtaining realizations of, 268- 272 
pole-zero plot of (fig.), 32 1 
poles and zeros, relation to frequency 
response, 286- 290 
rational, and LTI differential systems, 
259-264 
transform circuit 
diagrams, 334-340 
for mesh analysis, 338-340 
for nodal analysis, 334-338 
transformations of time variable, 4-7 
transforms 

Fourier. See Fourier transform 
Laplace. See Laplace transform 
z-transform. See z-transform 
transient and steady-state response of LTI 
differential systems, 274-276 
transmission 

in closed-loop transfer function, 386 
as complementary sensitivity function in 
feedback system, 390-393 
Tustin’s method, 631 
two-sided Laplace transform 
definition of, 224-226 
properties of, 236-240 
two-sided z-transform 

development of, 460-465 
properties of, 465^168 


U 

underdamped systems, 302 
unilateral Laplace transform 

analysis of LTI differential systems with 
initial conditions, 272-273 
definition of, 243-244 
properties of, 244-247 
unilateral z-transform, 483-486 
unit doublet described, 33-34 
unit impulse 
described, 25 

generalized function definition, 28 
response of LTI system, 68-69 
signal (fig.), 30 


unit doublet and higher derivatives, 
33-34 

unit ramp signal, 27 

unit step response of LTI system, 79-80 
unity feedback systems 
described, 385 
stability in, 394 
upsampling 

described, 5, 432 
and DTFT, 441 
and z-transform, 466 

V 

Vandermonde matrix, 111 
variables, continuous vs. discrete, 2 
voltage, Kirchhoffs Voltage Law (KVL), 
332 

voltage controlled oscillator (VCO), 601 

W 

Watt, James, 381 

waves, Fourier series of periodic rectangu- 
lar, 141-144 

windowing, FIR filter design by, 527-531 


z-transform 

development of two-sided, 460^165 
discrete-time state-space systems 
solution, 625-627 
and DTFT, relationship between, 
497-504 
inverse, 468-474 
pole-zero plot (fig.), 463, 468 
properties of, 465-468 
of system’s impulse response, 118 
two-sided. See two-sided z-transform 
unilateral, 483-486 
zero-input responses 
described, 273 

of discrete-time state-space systems, 
622-625 

of continuous-time state-space systems, 
360-366 

zero-order hold (ZOH) and signal recon- 
struction, 547-548 

zero-state response, 94, 273, 360-366, 
622-625 
zeros 

and poles of rational Laplace transforms, 
235-236 

and poles of transfer function, 260-261 



